directive Module

class pipelet.directive.Depend

Bases: pipelet.directive.Directive

Depend directive are used to include external code to the hashkey computation.

class pipelet.directive.Directive

Parse the segment code to get directives (multiplex, depend, ...)

parse(code)

Parse the code to initialiaze directive names and values.

Directive names and value are class attributs.

class pipelet.directive.Multiplex

Bases: pipelet.directive.Directive

Multiplex directives are used to control the pipeline parallelisation scheme.

pipelet.multiplex.cross_prod(*args)

Return the cartesian product of the input sets.

>>> print(len(cross_prod(['a','b'])))
2
>>> print(len(cross_prod(['a','b'],[1,2,3])))
6
>>> print(len(cross_prod(['a','b'],[1,2,3],[0.1,0.2,0.3,0.4])))
24

pipelet.multiplex.union(*args)

Return the union of the input sets.

>>> print(len(union(['a','b'])))
2
>>> print(len(union(['a','b'],[1,2,3])))
5
>>> print(len(union(['a','b'],[1,2,3],[0.1,0.2,0.3,0.4])))
9