22bce0332c94639df80820a439e4c1893a5552f8,mindsdb/libs/data_sources/file_ds.py,FileDS,_getDataIo,#FileDS#Any#,58
Before Change
// lets try to figure out if its a csv
try:
data.seek(0)
full = len(data.read())
data.seek(0)
bytes_to_read = int(full*0.3)
dialect = csv.Sniffer().sniff(data.read(bytes_to_read))
data.seek(0)
// if csv dialect identified then return csv
if dialect:
After Change
data.seek(0)
first_few_lines = []
i = 0
for line in data:
i += 1
first_few_lines.append(line)
if i > 500:
break
dialect = csv.Sniffer().sniff("".join(first_few_lines))
data.seek(0)
// if csv dialect identified then return csv
if dialect:
In pattern: SUPERPATTERN
Frequency: 3
Non-data size: 8
Instances Project Name: mindsdb/mindsdb
Commit Name: 22bce0332c94639df80820a439e4c1893a5552f8
Time: 2019-02-01
Author: george@cerebralab.com
File Name: mindsdb/libs/data_sources/file_ds.py
Class Name: FileDS
Method Name: _getDataIo
Project Name: rwth-i6/returnn-experiments
Commit Name: a21861f99e3dc4b778fd776b3e8e00dbaee988ca
Time: 2021-03-27
Author: albzey@gmail.com
File Name: common/models/encoder/blstm_cnn_specaug.py
Class Name:
Method Name: make_net
Project Name: mindsdb/mindsdb
Commit Name: bafbfaa5718e1de72b805237d2c350aec11de9fe
Time: 2019-02-01
Author: george@cerebralab.com
File Name: mindsdb/libs/data_sources/file_ds.py
Class Name: FileDS
Method Name: _getDataIo