Edit

@4me/post-ops.uploader

Required variables

• PORT (required)

  • Port the application the will run on

  • Example: PORT=4000

• S3_BUCKET (required)

  • S3 target bucket

  • Example: S3_BUCKET=my-bucket

• S3_BUCKET_PREFIX (required)

  • S3 bucket prefix

  • Example: S3_BUCKET_PREFIX=4me_ops

Optional variables

• LOG_PRETTY

  • Enable/disable human readable logs. JSON logs will be produced otherwise.

  • Example: LOG_PRETTY=1

  • Default value: process.env.NODE_ENV === 'development'

• LOG_LEVEL

  • Change the log level. Possible values are fatal, error, warn, info, debug or trace.

  • Example: LOG_LEVEL=trace

  • Default value: process.env.NODE_ENV === 'development' ? 'debug' : 'info'

• CONFIG

  • Location of the configuration file

  • Example: CONFIG=/config/config.yml

  • Default value: /config.yml

• AWS_ACCESS_KEY_ID

  • AWS Credentials (pulled from env, ~/.aws/config file, or instance metadata)

  • Example: AWS_ACCESS_KEY_ID=yyyy

• AWS_SECRET_ACCESS_KEY

  • AWS Credentials (pulled from env, ~/.aws/config file, or instance metadata)

  • Example: AWS_SECRET_ACCESS_KEY=xxxx

Config file

• config.yml.example (YML):

  jobs:
  - name: xman-egll
    type: http
    source: http://xman-fetcher-egll/raw
    period: 30
    s3_bucket: test
    output_folder: 4me_ops/xman
    file_prefix: egll
    file_extension: json
  - name: xman-lszh
    type: http
    source: http://xman-fetcher-lszh/raw
    period: 30
    s3_bucket: test
    output_folder: 4me_ops/xman
    file_prefix: lszh
    file_extension: json