bbc476eef9f090381c6afcae4e72478a07e5d9d2,petastorm/etl/dataset_metadata.py,,get_schema_from_dataset_url,#Any#,333

Before Change


    :return: A :class:`petastorm.unischema.Unischema` object
    
    resolver = FilesystemResolver(dataset_url)
    dataset = pq.ParquetDataset(resolver.parsed_dataset_url().path, filesystem=resolver.filesystem(),
                                validate_schema=False)

    // Get a unischema stored in the dataset metadata.

After Change


    :return: A :class:`petastorm.unischema.Unischema` object
    
    resolver = FilesystemResolver(dataset_url)
    dataset = pq.ParquetDataset(resolver.get_dataset_path(), filesystem=resolver.filesystem(),
                                validate_schema=False)

    // Get a unischema stored in the dataset metadata.
Italian Trulli
In pattern: SUPERPATTERN

Frequency: 9

Non-data size: 3

Instances


Project Name: uber/petastorm
Commit Name: bbc476eef9f090381c6afcae4e72478a07e5d9d2
Time: 2018-10-26
Author: vip@uber.com
File Name: petastorm/etl/dataset_metadata.py
Class Name:
Method Name: get_schema_from_dataset_url


Project Name: uber/petastorm
Commit Name: bbc476eef9f090381c6afcae4e72478a07e5d9d2
Time: 2018-10-26
Author: vip@uber.com
File Name: petastorm/reader.py
Class Name:
Method Name: make_reader


Project Name: uber/petastorm
Commit Name: bbc476eef9f090381c6afcae4e72478a07e5d9d2
Time: 2018-10-26
Author: vip@uber.com
File Name: petastorm/reader_impl/row_group_loader.py
Class Name: RowGroupLoader
Method Name: __init__


Project Name: uber/petastorm
Commit Name: bbc476eef9f090381c6afcae4e72478a07e5d9d2
Time: 2018-10-26
Author: vip@uber.com
File Name: petastorm/etl/petastorm_generate_metadata.py
Class Name:
Method Name: generate_petastorm_metadata


Project Name: uber/petastorm
Commit Name: bbc476eef9f090381c6afcae4e72478a07e5d9d2
Time: 2018-10-26
Author: vip@uber.com
File Name: petastorm/spark_utils.py
Class Name:
Method Name: dataset_as_rdd


Project Name: uber/petastorm
Commit Name: bbc476eef9f090381c6afcae4e72478a07e5d9d2
Time: 2018-10-26
Author: vip@uber.com
File Name: petastorm/reader_impl/reader_v2.py
Class Name: ReaderV2
Method Name: __init__


Project Name: uber/petastorm
Commit Name: bbc476eef9f090381c6afcae4e72478a07e5d9d2
Time: 2018-10-26
Author: vip@uber.com
File Name: petastorm/etl/dataset_metadata.py
Class Name:
Method Name: materialize_dataset


Project Name: uber/petastorm
Commit Name: bbc476eef9f090381c6afcae4e72478a07e5d9d2
Time: 2018-10-26
Author: vip@uber.com
File Name: petastorm/etl/metadata_util.py
Class Name:
Method Name:


Project Name: uber/petastorm
Commit Name: 0f054f48eabd6036da972d687293517d43f65405
Time: 2019-01-25
Author: joshua.goller@uber.com
File Name: petastorm/reader.py
Class Name:
Method Name: make_batch_reader