be586023bf4529559ad10388b6cf01672c635599,snips_nlu/tokenization.py,,,#,4

Before Change

import re
from collections import namedtuple

Token = namedtuple("Token", "value start end")

TOKEN_REGEX = re.compile(r"\w+", re.UNICODE)

After Change



from snips_nlu.utils import namedtuple_with_defaults

Token = namedtuple_with_defaults("Token", "value start end stem", {
    "stem": None})

TOKEN_REGEX = re.compile(r"\w+", re.UNICODE)
Italian Trulli
In pattern: SUPERPATTERN

Frequency: 3

Non-data size: 4

Instances


Project Name: snipsco/snips-nlu
Commit Name: be586023bf4529559ad10388b6cf01672c635599
Time: 2017-03-31
Author: adrien.ball@snips.net
File Name: snips_nlu/tokenization.py
Class Name:
Method Name:


Project Name: pfnet-research/chainer-chemistry
Commit Name: ec9520b39f585d22894802c23b7a735f19752c8a
Time: 2018-02-25
Author: mottodora@gmail.com
File Name: chainer_chemistry/dataset/parsers/sdf_file_parser.py
Class Name: SDFFileParser
Method Name: parse


Project Name: pfnet-research/chainer-chemistry
Commit Name: ec9520b39f585d22894802c23b7a735f19752c8a
Time: 2018-02-25
Author: mottodora@gmail.com
File Name: chainer_chemistry/dataset/parsers/csv_file_parser.py
Class Name: CSVFileParser
Method Name: parse