@4me/post-ops.uploader
Required variables
PORT (required)
Port the application the will run on
Example:
PORT=4000
S3_BUCKET (required)
S3 target bucket
Example:
S3_BUCKET=my-bucket
S3_BUCKET_PREFIX (required)
S3 bucket prefix
Example:
S3_BUCKET_PREFIX=4me_ops
Optional variables
LOG_PRETTY
Enable/disable human readable logs. JSON logs will be produced otherwise.
Example:
LOG_PRETTY=1
Default value:
process.env.NODE_ENV === 'development'
LOG_LEVEL
Change the log level. Possible values are fatal, error, warn, info, debug or trace.
Example:
LOG_LEVEL=trace
Default value:
process.env.NODE_ENV === 'development' ? 'debug' : 'info'
CONFIG
Location of the configuration file
Example:
CONFIG=/config/config.yml
Default value:
/config.yml
AWS_ACCESS_KEY_ID
AWS Credentials (pulled from env, ~/.aws/config file, or instance metadata)
Example:
AWS_ACCESS_KEY_ID=yyyy
AWS_SECRET_ACCESS_KEY
AWS Credentials (pulled from env, ~/.aws/config file, or instance metadata)
Example:
AWS_SECRET_ACCESS_KEY=xxxx
Config file
- config.yml.example (YML):
jobs:
- name: xman-egll
type: http
source: http://xman-fetcher-egll/raw
period: 30
s3_bucket: test
output_folder: 4me_ops/xman
file_prefix: egll
file_extension: json
- name: xman-lszh
type: http
source: http://xman-fetcher-lszh/raw
period: 30
s3_bucket: test
output_folder: 4me_ops/xman
file_prefix: lszh
file_extension: json