Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • D DeepPavlov
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 18
    • Issues 18
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 22
    • Merge requests 22
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • DeepPavlov
  • DeepPavlov
  • Merge requests
  • !1608

Refactor faq models

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Andrei Glinskii requested to merge feat/new_faq into dev Dec 09, 2022
  • Overview 68
  • Commits 43
  • Pipelines 0
  • Changes 27

Created by: nastyachizhikova

FAQ refactored:

  • old MIPT FAQ dataset replaced with English and Russian subsets of the MASSIVE dataset
  • fasttext_logreg model added
  • language versatility added to the config with integration of the LANGUAGE meta variable

Removed models:

  • fasttext_avg_autofaq
  • fasttext_tfidf_autofaq
  • tfidf_autofaq
  • tfidf_logreg_autofaq
  • tfidf_logreg_en_faq
  • tfidf_vectorizer
  • tfidf_logreg_autofaq_psearch
  • cv_tfidf_autofaq

removed components:

  • ru_tokenizer

other library improvements:

  • few-shot sampling support added to basic_classification_iterator
  • ru_tokenizer component replaced with stream_spacy_tokenizer
  • PyMorphy removed from requirements
Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: feat/new_faq