butterfree package

Subpackages

• butterfree.clients package
  • Submodules
    • AbstractClient
      • AbstractClient.conn
      • AbstractClient.get_schema()
      • AbstractClient.table
      • AbstractClient.sql()
    • CassandraClient
      • CassandraClient.user
      • CassandraClient.password
      • CassandraClient.keyspace
      • CassandraClient.host
      • CassandraClient.conn
      • CassandraClient.create_table()
      • CassandraClient.columns
      • CassandraClient.get_schema()
      • CassandraClient.table
      • CassandraClient.sql()
      • CassandraClient.query
    • CassandraColumn
      • CassandraColumn.column_name
      • CassandraColumn.primary_key
      • CassandraColumn.type
    • SparkClient
      • SparkClient.add_table_partitions()
      • SparkClient.conn
      • SparkClient.create_temporary_view()
      • SparkClient.get_schema()
      • SparkClient.table
      • SparkClient.read()
      • SparkClient.read_table()
      • SparkClient.sql()
      • SparkClient.write_dataframe()
      • SparkClient.write_stream()
      • SparkClient.write_table()
  • Module contents
    • AbstractClient
      • AbstractClient.conn
      • AbstractClient.get_schema()
      • AbstractClient.table
      • AbstractClient.sql()
    • CassandraClient
      • CassandraClient.user
      • CassandraClient.password
      • CassandraClient.keyspace
      • CassandraClient.host
      • CassandraClient.conn
      • CassandraClient.create_table()
      • CassandraClient.columns
      • CassandraClient.get_schema()
      • CassandraClient.table
      • CassandraClient.sql()
      • CassandraClient.query
    • SparkClient
      • SparkClient.add_table_partitions()
      • SparkClient.conn
      • SparkClient.create_temporary_view()
      • SparkClient.get_schema()
      • SparkClient.table
      • SparkClient.read()
      • SparkClient.read_table()
      • SparkClient.sql()
      • SparkClient.write_dataframe()
      • SparkClient.write_stream()
      • SparkClient.write_table()
• butterfree.configs package
  • Subpackages
    • butterfree.configs.db package
      • Submodules
      • Module contents
  • Submodules
    • UnspecifiedVariableError
      • UnspecifiedVariableError.variable_name
    • get_variable()
  • Module contents
• butterfree.constants package
  • Submodules
    • DataType
      • DataType.ARRAY_BIGINT
      • DataType.ARRAY_FLOAT
      • DataType.ARRAY_STRING
      • DataType.BIGINT
      • DataType.BINARY
      • DataType.BOOLEAN
      • DataType.DATE
      • DataType.DECIMAL
      • DataType.DOUBLE
      • DataType.FLOAT
      • DataType.INTEGER
      • DataType.STRING
      • DataType.TIMESTAMP
  • Module contents
    • DataType
      • DataType.ARRAY_BIGINT
      • DataType.ARRAY_FLOAT
      • DataType.ARRAY_STRING
      • DataType.BIGINT
      • DataType.BINARY
      • DataType.BOOLEAN
      • DataType.DATE
      • DataType.DECIMAL
      • DataType.DOUBLE
      • DataType.FLOAT
      • DataType.INTEGER
      • DataType.STRING
      • DataType.TIMESTAMP
• butterfree.dataframe_service package
  • Submodules
    • IncrementalStrategy
      • IncrementalStrategy.column
      • IncrementalStrategy.filter_with_incremental_strategy()
      • IncrementalStrategy.from_milliseconds()
      • IncrementalStrategy.from_string()
      • IncrementalStrategy.from_year_month_day_partitions()
      • IncrementalStrategy.get_expression()
    • extract_partition_values()
    • repartition_df()
    • repartition_sort_df()
  • Module contents
    • IncrementalStrategy
      • IncrementalStrategy.column
      • IncrementalStrategy.filter_with_incremental_strategy()
      • IncrementalStrategy.from_milliseconds()
      • IncrementalStrategy.from_string()
      • IncrementalStrategy.from_year_month_day_partitions()
      • IncrementalStrategy.get_expression()
    • extract_partition_values()
    • repartition_df()
    • repartition_sort_df()
• butterfree.extract package
  • Subpackages
    • butterfree.extract.pre_processing package
      • Submodules
      • Module contents
    • butterfree.extract.readers package
      • Submodules
      • Module contents
  • Submodules
    • Source
      • Source.readers
      • Source.query
      • Source.construct()
  • Module contents
    • Source
      • Source.readers
      • Source.query
      • Source.construct()
• butterfree.hooks package
  • Subpackages
    • butterfree.hooks.schema_compatibility package
      • Submodules
      • Module contents
  • Submodules
    • Hook
      • Hook.run()
    • HookableComponent
      • HookableComponent.pre_hooks
      • HookableComponent.post_hooks
      • HookableComponent.enable_pre_hooks
      • HookableComponent.enable_post_hooks
      • HookableComponent.add_post_hook()
      • HookableComponent.add_pre_hook()
      • HookableComponent.enable_post_hooks
      • HookableComponent.enable_pre_hooks
      • HookableComponent.post_hooks
      • HookableComponent.pre_hooks
      • HookableComponent.run_post_hooks()
      • HookableComponent.run_pre_hooks()
  • Module contents
    • Hook
      • Hook.run()
    • HookableComponent
      • HookableComponent.pre_hooks
      • HookableComponent.post_hooks
      • HookableComponent.enable_pre_hooks
      • HookableComponent.enable_post_hooks
      • HookableComponent.add_post_hook()
      • HookableComponent.add_pre_hook()
      • HookableComponent.enable_post_hooks
      • HookableComponent.enable_pre_hooks
      • HookableComponent.post_hooks
      • HookableComponent.pre_hooks
      • HookableComponent.run_post_hooks()
      • HookableComponent.run_pre_hooks()
• butterfree.load package
  • Subpackages
    • butterfree.load.processing package
      • Submodules
      • Module contents
    • butterfree.load.writers package
      • Submodules
      • Module contents
  • Submodules
    • Sink
      • Sink.writers
      • Sink.validation
      • Sink.flush()
      • Sink.validate()
      • Sink.validation
      • Sink.writers
  • Module contents
    • Sink
      • Sink.writers
      • Sink.validation
      • Sink.flush()
      • Sink.validate()
      • Sink.validation
      • Sink.writers
• butterfree.migrations package
  • Subpackages
    • butterfree.migrations.database_migration package
      • Submodules
      • Module contents
  • Module contents
• butterfree.pipelines package
  • Submodules
    • FeatureSetPipeline
      • FeatureSetPipeline.source
      • FeatureSetPipeline.feature_set
      • FeatureSetPipeline.sink
      • FeatureSetPipeline.spark_client
      • FeatureSetPipeline.feature_set
      • FeatureSetPipeline.run()
      • FeatureSetPipeline.run_for_date()
      • FeatureSetPipeline.sink
      • FeatureSetPipeline.source
      • FeatureSetPipeline.spark_client
  • Module contents
    • FeatureSetPipeline
      • FeatureSetPipeline.source
      • FeatureSetPipeline.feature_set
      • FeatureSetPipeline.sink
      • FeatureSetPipeline.spark_client
      • FeatureSetPipeline.feature_set
      • FeatureSetPipeline.run()
      • FeatureSetPipeline.run_for_date()
      • FeatureSetPipeline.sink
      • FeatureSetPipeline.source
      • FeatureSetPipeline.spark_client
• butterfree.reports package
  • Submodules
    • Metadata
      • Metadata.pipeline
      • Metadata.save
      • Metadata.to_json()
      • Metadata.to_markdown()
  • Module contents
    • Metadata
      • Metadata.pipeline
      • Metadata.save
      • Metadata.to_json()
      • Metadata.to_markdown()
• butterfree.testing package
  • Subpackages
    • butterfree.testing.dataframe package
      • Module contents
  • Module contents
• butterfree.transform package
  • Subpackages
    • butterfree.transform.features package
      • Submodules
      • Module contents
    • butterfree.transform.transformations package
      • Subpackages
      • Submodules
      • Module contents
    • butterfree.transform.utils package
      • Submodules
      • Module contents
  • Submodules
    • AggregatedFeatureSet
      • AggregatedFeatureSet.construct()
      • AggregatedFeatureSet.define_start_date()
      • AggregatedFeatureSet.features
      • AggregatedFeatureSet.features_columns
      • AggregatedFeatureSet.get_schema()
      • AggregatedFeatureSet.with_distinct()
      • AggregatedFeatureSet.with_pivot()
      • AggregatedFeatureSet.with_windows()
    • FeatureSet
      • FeatureSet.name
      • FeatureSet.entity
      • FeatureSet.description
      • FeatureSet.keys
      • FeatureSet.timestamp
      • FeatureSet.features
      • FeatureSet.columns
      • FeatureSet.construct()
      • FeatureSet.define_start_date()
      • FeatureSet.description
      • FeatureSet.entity
      • FeatureSet.features
      • FeatureSet.features_columns
      • FeatureSet.get_schema()
      • FeatureSet.keys
      • FeatureSet.keys_columns
      • FeatureSet.name
      • FeatureSet.timestamp
      • FeatureSet.timestamp_column
  • Module contents
    • FeatureSet
      • FeatureSet.name
      • FeatureSet.entity
      • FeatureSet.description
      • FeatureSet.keys
      • FeatureSet.timestamp
      • FeatureSet.features
      • FeatureSet.columns
      • FeatureSet.construct()
      • FeatureSet.define_start_date()
      • FeatureSet.description
      • FeatureSet.entity
      • FeatureSet.features
      • FeatureSet.features_columns
      • FeatureSet.get_schema()
      • FeatureSet.keys
      • FeatureSet.keys_columns
      • FeatureSet.name
      • FeatureSet.timestamp
      • FeatureSet.timestamp_column
• butterfree.validations package
  • Submodules
    • BasicValidation
      • BasicValidation.dataframe
      • BasicValidation.check()
      • BasicValidation.validate_column_ts()
      • BasicValidation.validate_df_is_empty()
      • BasicValidation.validate_df_is_spark_df()
    • Validation
      • Validation.dataframe
      • Validation.check()
      • Validation.input()
  • Module contents
    • BasicValidation
      • BasicValidation.dataframe
      • BasicValidation.check()
      • BasicValidation.validate_column_ts()
      • BasicValidation.validate_df_is_empty()
      • BasicValidation.validate_df_is_spark_df()

Module contents

Module docstring example, following Google’s docstring style.