c0833c03181a2a9a2ce50bf43281ba698f61887c,workers/data_refinery_workers/processors/smasher.py,,_smash_all,#Any#,303
Before Change
processor_job_id=job_context["job_id"],
num_input_files=job_context["num_input_files"])
job_context["dataset"].success = False
job_context["job"].failure_reason = "Failure reason: " + str(e)
job_context["dataset"].failure_reason = "Failure reason: " + str(e)
job_context["dataset"].save()
// Delay failing this pipeline until the failure notify has been sent
job_context["job"].success = False
After Change
try:
shutil.make_archive(final_zip_base, "zip", job_context["output_dir"])
except:
raise utils.ProcessorJobError("Smash Error while generating zip file", success=False)
job_context["output_file"] = final_zip_base + ".zip"
job_context["dataset"].success = True
In pattern: SUPERPATTERN
Frequency: 3
Non-data size: 3
Instances
Project Name: AlexsLemonade/refinebio
Commit Name: c0833c03181a2a9a2ce50bf43281ba698f61887c
Time: 2019-12-24
Author: arielsvn@gmail.com
File Name: workers/data_refinery_workers/processors/smasher.py
Class Name:
Method Name: _smash_all
Project Name: AlexsLemonade/refinebio
Commit Name: c0833c03181a2a9a2ce50bf43281ba698f61887c
Time: 2019-12-24
Author: arielsvn@gmail.com
File Name: workers/data_refinery_workers/processors/smasher.py
Class Name:
Method Name: _upload
Project Name: AlexsLemonade/refinebio
Commit Name: 6a1a1b23b269107121f3d1a97ec78a344fe35bb3
Time: 2019-12-23
Author: arielsvn@gmail.com
File Name: workers/data_refinery_workers/processors/smasher.py
Class Name:
Method Name: _notify