leaf_engine.etl.tasks.pull_lighthouse_data ========================================== .. py:module:: leaf_engine.etl.tasks.pull_lighthouse_data Functions --------- .. autoapisummary:: leaf_engine.etl.tasks.pull_lighthouse_data.normalize_lanes leaf_engine.etl.tasks.pull_lighthouse_data.pull_lighthouse_data leaf_engine.etl.tasks.pull_lighthouse_data.upload_file Module Contents --------------- .. py:function:: normalize_lanes(lanes_df: pandas.DataFrame) -> pandas.DataFrame Normalizes lighthouse lanes data for clustering and UUID pipeline tasks. :param lanes_df: Lanes DataFrame. :type lanes_df: pd.DataFrame :returns: Normalized lanes DataFrame. :rtype: pd.DataFrame .. py:function:: pull_lighthouse_data(params) -> List[pandas.DataFrame] Pulls lighthouse shipper data for internal run. Filters down to only latest batch. :param adapt_params: Adapt params. :type adapt_params: dict :returns: DataFrame's containing lighthouse lanes. :rtype: DataFrame .. py:function:: upload_file(params, lanes_df: pandas.DataFrame) -> None Uploads lanes DataFrame to g-drive. :param params: Params. :type params: dict :param lanes_df: Lanes DataFrame. :type lanes_df: pd.DataFrame :returns: None