mix storehouse.reprocess (Storehouse v0.2.0)

Copy Markdown View Source

Runs analysis steps over the files of a field in every record of a schema (Storehouse.Ecto.reprocess/5), with its progress: a step added after files were stored, files from before analysis existed.

mix storehouse.reprocess --repo MyApp.Repo --schema MyApp.Photo --field image \
  --step MyApp.Analyzers.Placeholder

Files that have every step's result already are skipped, so it can be stopped and run again: it does only what is missing. Each batch prints the primary key it got to, which --after starts after.

Options

  • --repo, --schema, --field - the records and their field of files.
  • --step - an analysis step, by module; once for each. For a step with options, call Storehouse.Ecto.reprocess/5 from a script.
  • --now - run the steps here, and save their results before it ends; the default gives each file to the app's runner, as a job.
  • --force - run every file's steps again.
  • --batch-size - records read at a time. The default is 500.
  • --concurrency - with --now, files at once. The default is 4.
  • --after - the primary key to start after.