S3 Storage (Recommended)
AWS S3 storage mode stores all generated data in an S3 bucket as Gzipped files. This allows for generating large amounts of data without slowing down your database. This is the recommended mode for most purposes.
To get started with AWS S3 Storage Mode, first create a bucket and name it whatever you'd like. Make sure that your AWS Access Key has permissions to access this bucket.
Now, simply make sure the following configuration fields are present in your datalus.conf
file.
STORAGE_MODE=aws
AWS_ACCESS_KEY={{AWS ACCESS KEY GOES HERE}}
AWS_SECRET_ACCESS_KEY={{AWS SECRET ACCESS KEY GOES HERE}}
AWS_REGION=us-east-1
AWS_BUCKET={{BUCKET NAME GOES HERE}}
Verify that the AWS_REGION
field matches the region the bucket is in.
Restart your API server and generated data will now be stored on S3.
Note: S3 mode only stores synthetic data, and is not used for storing any data such as user accounts, project setups, and other settings. Even with S3 mode, you must have a database to run a Datalus instance.