Files

Uploading File
File Links
Limits

The File Storage is available in the Files section of Storage and contains all raw files uploaded to your project. It also contains files with data exported from tables. These are created when you request to export a table from Table Storage. The File Storage serves two main purposes:

Files can be used to store an arbitrary file.
Every data table file is stored in Files before it is processed and pushed into a table.

Uploading File

To store an arbitrary file, select the Files tab in Storage and then click Upload File in the top right corner.

In the following dialog, select a file to upload along with other options:

For each uploaded file, you can enter an arbitrary number of tags in the Tags field, separating individual tags by pressing Enter. The tags can be used for filtering files later.

Important: The name of an uploaded file does not have to be unique because files are identified by their ID assigned on upload.

To avoid files being automatically deleted after 15 days (by default) and to keep them permanently, do not forget to tick the respective checkbox.

Also by default, uploaded files are marked as non-public. They are available only to the project administrators (those listed in the Users & Settings section) and users with Storage tokens who have the permission to Read all file uploads. Users with restricted Files permission can access only their own files and the files they uploaded themselves. For each file in Files, you can

copy its download link,
download the file, and
delete the file.

File Links

If you copy a link of a non-public file, you will obtain a URL in the following format:

https://s3.amazonaws.com/kbc-sapi-files/exp-15/1134/files/2016/06/12/191341241.private.csv?X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAJ2N244XSWYVVYVLQ%2F20160617%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20160617T174909Z&X-Amz-SignedHeaders=host&X-Amz-Expires=3600&X-Amz-Signature=30007ae706388816aaf3bd9ad585d9a30df6ab50dcc126881efbe6423ef57909

Such a URL is valid for only one hour from the time of its generation — the time when the File upload list was shown to you, not when you clicked the link.

Important: The URL itself does not require any other authorization. That is, you can send a link to non-public files to people without access to your Keboola project and they will be able to download that file via the direct link. However, they will not be able to generate or guess the link themselves.

If you copy a link to a public file, you will obtain a URL in the following format:

https://s3.amazonaws.com/kbc-sapi-files/exp-15/1134/files/2016/06/17/192119408.public.csv

Such a URL is valid for the entire validity of the file itself (either 15 days or forever).

In some cases, the file may be sliced. When you encounter a sliced file, you will obtain a JSON manifest file instead of the actual file. This can happen for some exported or imported tables from Storage or files which are particularly large. Merging a sliced file requires a substantial effort.

Limits

The maximum allowed size of an uploaded file is currently 2 GB (2,048,000,000 bytes exactly). This applies to both file and table uploads. The actual table size may be bigger, because the table is uploaded as a compressed file. If you need to upload a larger file, you need to use sliced upload. In that case, the limit applies to the chunk size.

As stated above, unless marked as permanent, each file will be automatically deleted 15 days after its creation. This also applies to automatically generated files as a result of table imports and exports. In addition, because the majority of Keboola File Storage contains duplicates of your table data, the whole Files storage does not count towards your project quota.