Custom-Tokenizer

Custom Tokenizer Pipeline for faster utilization of vector embeddings in a vector database

Name		Name	Last commit message	Last commit date
Dynamic_Embedding_Storage_System.ipynb		Dynamic_Embedding_Storage_System.ipynb
EmbeddingCalculator.ipynb		EmbeddingCalculator.ipynb
NewDynamicStorageGenerator.ipynb		NewDynamicStorageGenerator.ipynb
NewNextQuestionPredictor.ipynb		NewNextQuestionPredictor.ipynb
README.md		README.md
TeacherStudentQueryPredictor(1).ipynb		TeacherStudentQueryPredictor(1).ipynb
TeacherStudentQueryPredictor.ipynb		TeacherStudentQueryPredictor.ipynb
WorkingTeacherGPU_Code.ipynb		WorkingTeacherGPU_Code.ipynb

Navigation Menu