5e621573fbd36f1f7fdf1002e403e5a9ba607f09,torchtext/datasets/enwik9.py,,EnWik9,#Any#Any#,19
Before Change
path = extracted_files[0]
logging.info("Creating {} data".format(split))
return _RawTextIterableDataset("EnWik9",
NUM_LINES[split], iter(io.open(path, encoding="utf8")))
After Change
path = extracted_files[0]
logging.info("Creating {} data".format(split))
return _RawTextIterableDataset(DATASET_NAME,
NUM_LINES[split], _read_text_iterator(path))
In pattern: SUPERPATTERN
Frequency: 5
Non-data size: 4
Instances
Project Name: pytorch/text
Commit Name: 5e621573fbd36f1f7fdf1002e403e5a9ba607f09
Time: 2021-03-05
Author: parmeetbhatia@fb.com
File Name: torchtext/datasets/enwik9.py
Class Name:
Method Name: EnWik9
Project Name: pytorch/text
Commit Name: 5e621573fbd36f1f7fdf1002e403e5a9ba607f09
Time: 2021-03-05
Author: parmeetbhatia@fb.com
File Name: torchtext/datasets/penntreebank.py
Class Name:
Method Name: PennTreebank
Project Name: pytorch/text
Commit Name: 5e621573fbd36f1f7fdf1002e403e5a9ba607f09
Time: 2021-03-05
Author: parmeetbhatia@fb.com
File Name: torchtext/experimental/datasets/raw/wmtnewscrawl.py
Class Name:
Method Name: WMTNewsCrawl
Project Name: pytorch/text
Commit Name: 5e621573fbd36f1f7fdf1002e403e5a9ba607f09
Time: 2021-03-05
Author: parmeetbhatia@fb.com
File Name: torchtext/datasets/wikitext103.py
Class Name:
Method Name: WikiText103
Project Name: pytorch/text
Commit Name: 5e621573fbd36f1f7fdf1002e403e5a9ba607f09
Time: 2021-03-05
Author: parmeetbhatia@fb.com
File Name: torchtext/datasets/wikitext2.py
Class Name:
Method Name: WikiText2