LSD update: Generate Transformer Embeddings #5
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Implement latent representation generation for Transformers - Add HuggingFace and SentenceTransformer interface via config setup - Create comprehensive test suite for transformer functionality - Add sentence-transformers dependency - Fix versioning conflicts with updated dependencies - Complete Transformer base setup and generate methods - Add proper dataset loading and text extraction capabilities - Include configuration management for multiple transformer models Fixes transformer_gen branch goals: ✅ Transformer base: setup and generate ✅ HuggingFace and SBert interface via config setup ✅ Test Suite ✅ Identify versioning conflicts that default pre-LSD pypi
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Goal: include latent representation generation for Transformers