omnipy.shared.protocols.compute.job
| CLASS | DESCRIPTION |
|---|---|
IsDagFlow |
|
IsDagFlowTemplate |
|
IsFlow |
|
IsFlowTemplate |
|
IsFuncFlow |
|
IsFuncFlowTemplate |
|
IsLinearFlow |
|
IsLinearFlowTemplate |
|
IsTask |
|
IsTaskTemplate |
Loosely coupled type replacement for the :py:class: |
IsDagFlow
Bases: IsTaskTemplateArgsJob[IsTaskTemplate, 'IsDagFlowTemplate[_CallP, _RetCovT]', 'IsDagFlow[_CallP, _RetCovT]', _CallP, _RetCovT], IsFlow, Protocol[_CallP, _RetCovT]
| METHOD | DESCRIPTION |
|---|---|
__init__ |
|
create_job |
|
get_bound_args |
|
has_coroutine_func |
|
log |
|
regenerate_unique_name |
|
revise |
|
| ATTRIBUTE | DESCRIPTION |
|---|---|
auto_async |
TYPE:
|
config |
TYPE:
|
engine |
TYPE:
|
fixed_params |
TYPE:
|
flow_context |
TYPE:
|
in_flow_context |
TYPE:
|
iterate_over_data_files |
TYPE:
|
logger |
TYPE:
|
name |
TYPE:
|
output_dataset_cls |
TYPE:
|
output_dataset_param |
TYPE:
|
output_storage_protocol |
|
output_storage_protocol_to_use |
|
param_key_map |
TYPE:
|
param_signatures |
TYPE:
|
persist_outputs |
|
restore_outputs |
|
result_key |
TYPE:
|
return_type |
TYPE:
|
task_templates |
TYPE:
|
time_of_cur_toplevel_flow_run |
TYPE:
|
time_of_last_run |
TYPE:
|
unique_name |
TYPE:
|
will_persist_outputs |
|
will_restore_outputs |
|
Source code in src/omnipy/shared/protocols/compute/job.py
output_storage_protocol_to_use
property
output_storage_protocol_to_use: OutputStorageProtocolOptions.Literals
__init__
create_job
classmethod
get_bound_args
has_coroutine_func
log
regenerate_unique_name
IsDagFlowTemplate
Bases: IsTaskTemplateArgsJobTemplate[IsTaskTemplate, 'IsDagFlowTemplate[_CallP, _RetCovT]', 'IsDagFlow[_CallP, _RetCovT]', _CallP, _RetCovT], IsFlowTemplate, Protocol[_CallP, _RetCovT]
| METHOD | DESCRIPTION |
|---|---|
__init__ |
|
apply |
|
create_job_template |
|
get_bound_args |
|
has_coroutine_func |
|
log |
|
refine |
|
regenerate_unique_name |
|
run |
|
| ATTRIBUTE | DESCRIPTION |
|---|---|
auto_async |
TYPE:
|
config |
TYPE:
|
engine |
TYPE:
|
fixed_params |
TYPE:
|
in_flow_context |
TYPE:
|
iterate_over_data_files |
TYPE:
|
logger |
TYPE:
|
name |
TYPE:
|
output_dataset_cls |
TYPE:
|
output_dataset_param |
TYPE:
|
output_storage_protocol |
|
output_storage_protocol_to_use |
|
param_key_map |
TYPE:
|
param_signatures |
TYPE:
|
persist_outputs |
|
restore_outputs |
|
result_key |
TYPE:
|
return_type |
TYPE:
|
task_templates |
TYPE:
|
unique_name |
TYPE:
|
will_persist_outputs |
|
will_restore_outputs |
|
Source code in src/omnipy/shared/protocols/compute/job.py
output_storage_protocol_to_use
property
output_storage_protocol_to_use: OutputStorageProtocolOptions.Literals
__init__
apply
create_job_template
classmethod
get_bound_args
has_coroutine_func
log
refine
refine(
*task_templates: _TaskTemplateT,
update: bool = True,
name: str | None = None,
iterate_over_data_files: bool = False,
output_dataset_param: str | None = None,
output_dataset_cls: type[IsDataset] | None = None,
auto_async: bool = True,
result_key: str | None = None,
fixed_params: Mapping[str, object] | Iterable[tuple[str, object]] | None = None,
param_key_map: Mapping[str, str] | Iterable[tuple[str, str]] | None = None,
persist_outputs: PersistOutputsOptions.Literals = PersistOutputsOptions.FOLLOW_CONFIG,
restore_outputs: RestoreOutputsOptions.Literals = RestoreOutputsOptions.FOLLOW_CONFIG,
**kwargs: object,
) -> _JobTemplateT
Source code in src/omnipy/shared/protocols/compute/_job.py
regenerate_unique_name
IsFlow
Bases: Protocol
| ATTRIBUTE | DESCRIPTION |
|---|---|
flow_context |
TYPE:
|
time_of_last_run |
TYPE:
|
Source code in src/omnipy/shared/protocols/compute/job.py
IsFlowTemplate
IsFuncFlow
Bases: IsFuncArgJob['IsFuncFlowTemplate[_CallP, _RetCovT]', 'IsFuncFlow[_CallP, _RetCovT]', _CallP, _RetCovT], IsFlow, Protocol[_CallP, _RetCovT]
| METHOD | DESCRIPTION |
|---|---|
__init__ |
|
create_job |
|
get_bound_args |
|
has_coroutine_func |
|
log |
|
regenerate_unique_name |
|
revise |
|
| ATTRIBUTE | DESCRIPTION |
|---|---|
auto_async |
TYPE:
|
config |
TYPE:
|
engine |
TYPE:
|
fixed_params |
TYPE:
|
flow_context |
TYPE:
|
in_flow_context |
TYPE:
|
iterate_over_data_files |
TYPE:
|
logger |
TYPE:
|
name |
TYPE:
|
output_dataset_cls |
TYPE:
|
output_dataset_param |
TYPE:
|
output_storage_protocol |
|
output_storage_protocol_to_use |
|
param_key_map |
TYPE:
|
param_signatures |
TYPE:
|
persist_outputs |
|
restore_outputs |
|
result_key |
TYPE:
|
return_type |
TYPE:
|
time_of_cur_toplevel_flow_run |
TYPE:
|
time_of_last_run |
TYPE:
|
unique_name |
TYPE:
|
will_persist_outputs |
|
will_restore_outputs |
|
Source code in src/omnipy/shared/protocols/compute/job.py
output_storage_protocol_to_use
property
output_storage_protocol_to_use: OutputStorageProtocolOptions.Literals
__init__
create_job
classmethod
get_bound_args
has_coroutine_func
log
regenerate_unique_name
IsFuncFlowTemplate
Bases: IsFuncArgJobTemplate['IsFuncFlowTemplate[_CallP, _RetCovT]', 'IsFuncFlow[_CallP, _RetCovT]', _CallP, _RetCovT], IsFlowTemplate, Protocol[_CallP, _RetCovT]
| METHOD | DESCRIPTION |
|---|---|
__init__ |
|
apply |
|
create_job_template |
|
get_bound_args |
|
has_coroutine_func |
|
log |
|
refine |
|
regenerate_unique_name |
|
run |
|
| ATTRIBUTE | DESCRIPTION |
|---|---|
auto_async |
TYPE:
|
config |
TYPE:
|
engine |
TYPE:
|
fixed_params |
TYPE:
|
in_flow_context |
TYPE:
|
iterate_over_data_files |
TYPE:
|
logger |
TYPE:
|
name |
TYPE:
|
output_dataset_cls |
TYPE:
|
output_dataset_param |
TYPE:
|
output_storage_protocol |
|
output_storage_protocol_to_use |
|
param_key_map |
TYPE:
|
param_signatures |
TYPE:
|
persist_outputs |
|
restore_outputs |
|
result_key |
TYPE:
|
return_type |
TYPE:
|
unique_name |
TYPE:
|
will_persist_outputs |
|
will_restore_outputs |
|
Source code in src/omnipy/shared/protocols/compute/job.py
output_storage_protocol_to_use
property
output_storage_protocol_to_use: OutputStorageProtocolOptions.Literals
__init__
apply
create_job_template
classmethod
get_bound_args
has_coroutine_func
log
refine
refine(
*args: Any,
update: bool = True,
name: str | None = None,
iterate_over_data_files: bool = False,
output_dataset_param: str | None = None,
output_dataset_cls: type[IsDataset] | None = None,
auto_async: bool = True,
result_key: str | None = None,
fixed_params: Mapping[str, object] | Iterable[tuple[str, object]] | None = None,
param_key_map: Mapping[str, str] | Iterable[tuple[str, str]] | None = None,
persist_outputs: PersistOutputsOptions.Literals = PersistOutputsOptions.FOLLOW_CONFIG,
restore_outputs: RestoreOutputsOptions.Literals = RestoreOutputsOptions.FOLLOW_CONFIG,
**kwargs: object,
) -> _JobTemplateT
Source code in src/omnipy/shared/protocols/compute/_job.py
regenerate_unique_name
IsLinearFlow
Bases: IsTaskTemplateArgsJob[IsTaskTemplate, 'IsLinearFlowTemplate[_CallP, _RetCovT]', 'IsLinearFlow[_CallP, _RetCovT]', _CallP, _RetCovT], IsFlow, Protocol[_CallP, _RetCovT]
| METHOD | DESCRIPTION |
|---|---|
__init__ |
|
create_job |
|
get_bound_args |
|
has_coroutine_func |
|
log |
|
regenerate_unique_name |
|
revise |
|
| ATTRIBUTE | DESCRIPTION |
|---|---|
auto_async |
TYPE:
|
config |
TYPE:
|
engine |
TYPE:
|
fixed_params |
TYPE:
|
flow_context |
TYPE:
|
in_flow_context |
TYPE:
|
iterate_over_data_files |
TYPE:
|
logger |
TYPE:
|
name |
TYPE:
|
output_dataset_cls |
TYPE:
|
output_dataset_param |
TYPE:
|
output_storage_protocol |
|
output_storage_protocol_to_use |
|
param_key_map |
TYPE:
|
param_signatures |
TYPE:
|
persist_outputs |
|
restore_outputs |
|
result_key |
TYPE:
|
return_type |
TYPE:
|
task_templates |
TYPE:
|
time_of_cur_toplevel_flow_run |
TYPE:
|
time_of_last_run |
TYPE:
|
unique_name |
TYPE:
|
will_persist_outputs |
|
will_restore_outputs |
|
Source code in src/omnipy/shared/protocols/compute/job.py
output_storage_protocol_to_use
property
output_storage_protocol_to_use: OutputStorageProtocolOptions.Literals
__init__
create_job
classmethod
get_bound_args
has_coroutine_func
log
regenerate_unique_name
IsLinearFlowTemplate
Bases: IsTaskTemplateArgsJobTemplate[IsTaskTemplate, 'IsLinearFlowTemplate[_CallP, _RetCovT]', 'IsLinearFlow[_CallP, _RetCovT]', _CallP, _RetCovT], IsFlowTemplate, Protocol[_CallP, _RetCovT]
| METHOD | DESCRIPTION |
|---|---|
__init__ |
|
apply |
|
create_job_template |
|
get_bound_args |
|
has_coroutine_func |
|
log |
|
refine |
|
regenerate_unique_name |
|
run |
|
| ATTRIBUTE | DESCRIPTION |
|---|---|
auto_async |
TYPE:
|
config |
TYPE:
|
engine |
TYPE:
|
fixed_params |
TYPE:
|
in_flow_context |
TYPE:
|
iterate_over_data_files |
TYPE:
|
logger |
TYPE:
|
name |
TYPE:
|
output_dataset_cls |
TYPE:
|
output_dataset_param |
TYPE:
|
output_storage_protocol |
|
output_storage_protocol_to_use |
|
param_key_map |
TYPE:
|
param_signatures |
TYPE:
|
persist_outputs |
|
restore_outputs |
|
result_key |
TYPE:
|
return_type |
TYPE:
|
task_templates |
TYPE:
|
unique_name |
TYPE:
|
will_persist_outputs |
|
will_restore_outputs |
|
Source code in src/omnipy/shared/protocols/compute/job.py
output_storage_protocol_to_use
property
output_storage_protocol_to_use: OutputStorageProtocolOptions.Literals
__init__
apply
create_job_template
classmethod
get_bound_args
has_coroutine_func
log
refine
refine(
*task_templates: _TaskTemplateT,
update: bool = True,
name: str | None = None,
iterate_over_data_files: bool = False,
output_dataset_param: str | None = None,
output_dataset_cls: type[IsDataset] | None = None,
auto_async: bool = True,
result_key: str | None = None,
fixed_params: Mapping[str, object] | Iterable[tuple[str, object]] | None = None,
param_key_map: Mapping[str, str] | Iterable[tuple[str, str]] | None = None,
persist_outputs: PersistOutputsOptions.Literals = PersistOutputsOptions.FOLLOW_CONFIG,
restore_outputs: RestoreOutputsOptions.Literals = RestoreOutputsOptions.FOLLOW_CONFIG,
**kwargs: object,
) -> _JobTemplateT
Source code in src/omnipy/shared/protocols/compute/_job.py
regenerate_unique_name
IsTask
Bases: IsFuncArgJob['IsTaskTemplate[_CallP, _RetT]', 'IsTask[_CallP, _RetT]', _CallP, _RetT], Protocol[_CallP, _RetT]
| METHOD | DESCRIPTION |
|---|---|
__init__ |
|
create_job |
|
get_bound_args |
|
has_coroutine_func |
|
log |
|
regenerate_unique_name |
|
revise |
|
| ATTRIBUTE | DESCRIPTION |
|---|---|
auto_async |
TYPE:
|
config |
TYPE:
|
engine |
TYPE:
|
fixed_params |
TYPE:
|
in_flow_context |
TYPE:
|
iterate_over_data_files |
TYPE:
|
logger |
TYPE:
|
name |
TYPE:
|
output_dataset_cls |
TYPE:
|
output_dataset_param |
TYPE:
|
output_storage_protocol |
|
output_storage_protocol_to_use |
|
param_key_map |
TYPE:
|
param_signatures |
TYPE:
|
persist_outputs |
|
restore_outputs |
|
result_key |
TYPE:
|
return_type |
TYPE:
|
time_of_cur_toplevel_flow_run |
TYPE:
|
unique_name |
TYPE:
|
will_persist_outputs |
|
will_restore_outputs |
|
Source code in src/omnipy/shared/protocols/compute/job.py
output_storage_protocol_to_use
property
output_storage_protocol_to_use: OutputStorageProtocolOptions.Literals
__init__
create_job
classmethod
get_bound_args
has_coroutine_func
log
regenerate_unique_name
IsTaskTemplate
Bases: IsFuncArgJobTemplate['IsTaskTemplate[_CallP, _RetT]', 'IsTask[_CallP, _RetT]', _CallP, _RetT], Protocol[_CallP, _RetT]
Loosely coupled type replacement for the :py:class:~omnipy.compute.task.TaskTemplate class
| METHOD | DESCRIPTION |
|---|---|
__init__ |
|
apply |
|
create_job_template |
|
get_bound_args |
|
has_coroutine_func |
|
log |
|
refine |
|
regenerate_unique_name |
|
run |
|
| ATTRIBUTE | DESCRIPTION |
|---|---|
auto_async |
TYPE:
|
config |
TYPE:
|
engine |
TYPE:
|
fixed_params |
TYPE:
|
in_flow_context |
TYPE:
|
iterate_over_data_files |
TYPE:
|
logger |
TYPE:
|
name |
TYPE:
|
output_dataset_cls |
TYPE:
|
output_dataset_param |
TYPE:
|
output_storage_protocol |
|
output_storage_protocol_to_use |
|
param_key_map |
TYPE:
|
param_signatures |
TYPE:
|
persist_outputs |
|
restore_outputs |
|
result_key |
TYPE:
|
return_type |
TYPE:
|
unique_name |
TYPE:
|
will_persist_outputs |
|
will_restore_outputs |
|
Source code in src/omnipy/shared/protocols/compute/job.py
output_storage_protocol_to_use
property
output_storage_protocol_to_use: OutputStorageProtocolOptions.Literals
__init__
apply
create_job_template
classmethod
get_bound_args
has_coroutine_func
log
refine
refine(
*args: Any,
update: bool = True,
name: str | None = None,
iterate_over_data_files: bool = False,
output_dataset_param: str | None = None,
output_dataset_cls: type[IsDataset] | None = None,
auto_async: bool = True,
result_key: str | None = None,
fixed_params: Mapping[str, object] | Iterable[tuple[str, object]] | None = None,
param_key_map: Mapping[str, str] | Iterable[tuple[str, str]] | None = None,
persist_outputs: PersistOutputsOptions.Literals = PersistOutputsOptions.FOLLOW_CONFIG,
restore_outputs: RestoreOutputsOptions.Literals = RestoreOutputsOptions.FOLLOW_CONFIG,
**kwargs: object,
) -> _JobTemplateT