7d9a7fead18653a43645c3d673499cf639337406,lambdas/es/indexer/document_queue.py,DocumentQueue,send_all,#DocumentQueue#,127

Before Change


                    info = inner.get("error")
                    doc = id_to_doc[inner["_id"]]
                    // because error.error might be a string *sigh*
                    if isinstance(info, dict):
                        if "mapper_parsing_exception" in info.get("type", ""):
                            print("mapper_parsing_exception", error, inner)
                            // clear out structured metadata and try again
                            doc["user_meta"] = doc["system"] = {}
                        else:
                            print("unhandled indexer error:", error)
                    // Always retry, regardless of whether we know to handle and clean the request
                    // or not. This can catch temporary 403 on index write blocks and other
                    // transient issues.
                    send_again.append(doc)
                else:
                    // If index not in error, then retry the whole batch. Unclear what would cause
                    // that, but if there"s an error without an id we need to assume it applies to

After Change


                if "index" in error or "delete" in error:
                    if "index" in error:
                        inner = error["index"]
                    if "delete" in error:
                        inner = error["delete"]
                    if "_id" in inner:
                        doc = id_to_doc[inner["_id"]]
                        // Always retry the source document if we can identify it.
                        // This catches temporary 403 on index write blocks & other
Italian Trulli
In pattern: SUPERPATTERN

Frequency: 3

Non-data size: 8

Instances


Project Name: quiltdata/quilt
Commit Name: 7d9a7fead18653a43645c3d673499cf639337406
Time: 2020-06-03
Author: akarve@users.noreply.github.com
File Name: lambdas/es/indexer/document_queue.py
Class Name: DocumentQueue
Method Name: send_all


Project Name: J535D165/recordlinkage
Commit Name: 27abe9ced763bc831cd760e7ae7ee313db10b828
Time: 2017-08-24
Author: jonathandebruinhome@gmail.com
File Name: recordlinkage/base.py
Class Name: BaseCompare
Method Name: compare_vectorized


Project Name: senarvi/theanolm
Commit Name: 0375cb0a69852f21f19c8568b4a37128d4407fc0
Time: 2016-04-12
Author: seppo.git@marjaniemi.com
File Name: theanolm/architecture.py
Class Name: Architecture
Method Name: check_state