Module datafusion_physical_expr::utils

Structs

• ExprTreeNode

Functions

• build_dag
• collect_columns
  Recursively extract referenced Columns within a PhysicalExpr.
• convert_to_expr
  This function returns all Arc<dyn PhysicalExpr>s inside the given PhysicalSortExpr sequence.
• expr_list_eq_any_order
  Compare the two expr lists are equal no matter the order. For example two InListExpr can be considered to be equals no matter the order:
• expr_list_eq_strict_order
  Strictly compare the two expr lists are equal in the given order.
• get_finer_ordering
  Find the finer requirement among req1 and req2 If None, this means that req1 and req2 are not compatible e.g there is no requirement that satisfies both
• get_indices_of_matching_exprs
  This function finds the indices of targets within items, taking into account equivalences according to equal_properties.
• map_columns_before_projection
  This function maps back requirement after ProjectionExec to the Executor for its input.
• normalize_expr_with_equivalence_properties
• normalize_out_expr_with_columns_map
  Normalize the output expressions based on Columns Map.
• normalize_sort_exprs
  Transform sort_exprs vector, to standardized version using eq_properties and ordering_eq_properties Assume eq_properties states that Column a and Column b are aliases. Also assume ordering_eq_properties states that ordering vec![d ASC] and vec![a ASC, c ASC] are ordering equivalent (in the sense that both describe the ordering of the table). If the sort_exprs input to this function were vec![b ASC, c ASC], This function converts sort_exprs vec![b ASC, c ASC] to first vec![a ASC, c ASC] after considering eq_properties Then converts vec![a ASC, c ASC] to vec![d ASC] after considering ordering_eq_properties. Standardized version vec![d ASC] is used in subsequent operations.
• normalize_sort_requirements
  Transform sort_reqs vector, to standardized version using eq_properties and ordering_eq_properties Assume eq_properties states that Column a and Column b are aliases. Also assume ordering_eq_properties states that ordering vec![d ASC] and vec![a ASC, c ASC] are ordering equivalent (in the sense that both describe the ordering of the table). If the sort_reqs input to this function were vec![b Some(ASC), c None], This function converts sort_exprs vec![b Some(ASC), c None] to first vec![a Some(ASC), c None] after considering eq_properties Then converts vec![a Some(ASC), c None] to vec![d Some(ASC)] after considering ordering_eq_properties. Standardized version vec![d Some(ASC)] is used in subsequent operations.
• ordering_satisfy
  Checks whether given ordering requirements are satisfied by provided PhysicalSortExprs.
• ordering_satisfy_concrete
  Checks whether the required PhysicalSortExprs are satisfied by the provided PhysicalSortExprs.
• ordering_satisfy_requirement
  Checks whether the given PhysicalSortRequirements are satisfied by the provided PhysicalSortExprs.
• ordering_satisfy_requirement_concrete
  Checks whether the given PhysicalSortRequirements are satisfied by the provided PhysicalSortExprs.
• reassign_predicate_columns
  Re-assign column indices referenced in predicate according to given schema. This may be helpful when dealing with projections.
• requirements_compatible
  Checks whether the given PhysicalSortRequirements are equal or more specific than the provided PhysicalSortRequirements.
• reverse_order_bys
  Reverses the ORDER BY expression, which is useful during equivalent window expression construction. For instance, ‘ORDER BY a ASC, NULLS LAST’ turns into ‘ORDER BY a DESC, NULLS FIRST’.
• scatter
  Scatter truthy array by boolean mask. When the mask evaluates true, next values of truthy are taken, when the mask evaluates false values null values are filled.
• split_conjunction
  Assume the predicate is in the form of CNF, split the predicate to a Vec of PhysicalExprs.