Understand what Model Memory is and how it improves accuracy in Affinda.
Model Memory is a validated set of reference data and documents that Affinda’s models use to enhance accuracy over time. By leveraging Retrieval-Augmented Generation (RAG), Model Memory enables Affinda to dynamically reference previously validated documents, allowing the model to predict future documents more accurately without requiring constant retraining.
Continuous improvement – The model improves over time by referencing validated documents, ensuring better predictions without the need for extensive manual adjustments.
No need for constant prompt engineering – Instead of adjusting prompts for every case, Model Memory provides a more scalable approach to improving AI performance.
High accuracy for repeated formats – The system quickly learns and perfects the extraction for recurring document formats, such as invoices from a particular supplier.
When a new document is uploaded, Affinda’s Fingerprinting algorithm scans Model Memory to find sufficiently similar documents.
If relevant documents are found, one or more of these validated examples are provided to the model.
The model uses these documents to improve extraction accuracy and consistency.
By using this method, Model Memory provides the model with real-world examples, reducing the likelihood of errors and continuously improving the accuracy of document processing.
Users can control how documents are added to Model Memory through the Workspace Settings in the Affinda app. There are three options:
Auto (Default Option) – Affinda intelligently selects which documents are added.
Manual – No documents from the workspace are automatically added to Model Memory, even after validation.
Always – Every validated document from the workspace is added to Model Memory.
Auto is the recommended option for most Workspaces intended for ongoing model learning. Under these settings, document formats not already well-covered in Model Memory are intelligently selected, ensuring:
The memory does not grow excessively large, making it easier to audit.
The model remains efficient by avoiding redundant examples of well-represented formats.
Importance of Highly Accurate Data in Model Memory
Since Model Memory directly references individual documents and their validated data, the accuracy of annotated documents is critical. Incorrect or low-quality annotations can lead to:
Confusion in model predictions – The model may reference incorrect information, leading to erroneous outputs.
Propagation of mistakes – Since Model Memory applies learnings from past documents, any errors will be replicated in future extractions.
Use the Auto mode for document selection – This ensures a manageable and auditable dataset.
Correct errors promptly – Any errors discovered downstream should be corrected in the Affinda app to maintain data integrity.
Establish clear validation guidelines – If multiple team members validate documents, create clear annotation standards to prevent inconsistencies, especially in cases where ambiguity exists.
By following these best practices, organizations can maximize the effectiveness of Model Memory and achieve unparalleled accuracy in document processing.
How can I see what model memory document was referenced?
The user can see the model memory document referenced in each new document processed by clicking on the three dots in the left-hand corner of the Document Validation Interface, then selecting ‘Model Memory Reference’. This will open the confirmed document used by the model in prediction extractions. Users can make corrections to the reference document in this view.
Does a bigger model memory help my model performance?
Yes. In Affinda, Model Memory works like a living reference library: every document you validate is stored and later surfaced by the fingerprinting algorithm to guide new extractions. The more high-quality, diverse documents you keep in that memory, the greater the chance the model finds a close match and pulls the right examples, so accuracy improves without retraining.Just make sure the memory grows with relevant and correctly annotated files—Affinda’s recommended “Auto” mode keeps only representative samples so the memory doesn’t become bloated with duplicates, which could reinforce errors.
My Model Memory Document is incorrect, what do I do?
If you spot a mistake in a document that’s already sitting in Model Memory, it’s important you correct it promptly. Locate the document under the confirmed documents tab and open the Document Validation UI. Adjust the wrong annotations (drag them to the right spot or redraw them) and then click “Confirm Document”.Now you have corrected the error; you should re-parse any documents in the “For Review” tab to reapply the extraction model and prevent the propagation of mistakes.