Add UT for Data and Scorers library#26

Merged

JCamyre merged 30 commits intomainfrom

alex/add-unit-tests

Dec 27, 2024

Commits on Dec 24, 2024

remove post_init method from Example because it won't be called anyways. it's a BaseModel.
SecroLoL
committed
Merge remote-tracking branch 'origin/joseph/add-unit-tests' into alex/add-unit-tests
SecroLoL
committed
Add UT for data/example.py
SecroLoL
committed
Refactor to remove field variables from ProcessExample
SecroLoL
committed
Add UT for API Example
SecroLoL
committed
Add UT for data/result.py (ScoringResult)
SecroLoL
committed
Add UT for scorer_data.py script
SecroLoL
committed
Add UT for data/datasets/dataset.py
SecroLoL
committed
Assert that mock endpoints are called once
SecroLoL
committed
Add UT for data/datasets/ground_truth.py
SecroLoL
committed
Write UT for data/datasets/test_dataset_utils.py
SecroLoL
committed

Commits on Dec 25, 2024

Add UT for scorers/
SecroLoL
committed
Remove import for Example type hinting in custom_scorer.py to avoid circular imports.
SecroLoL
committed
Add UT for score.py functions a_safe_score_example and score_task
SecroLoL
committed
Add UT for score.py, TODO fix two of the failing test cases
SecroLoL
committed
Edit execute_with_semaphore() helper to prevent error propagation.
SecroLoL
committed
Add safe attribute checking for skipped scorers.
SecroLoL
committed
Fix two buggy tests for scoring utils functions.
SecroLoL
committed
Slight bufixes for the PromptScorer class: change _show_indicator to display_meter and make schema enforcement prompt use the actual type of the object instead of the raw name.
SecroLoL
committed
Add UT for PromptScorer code.
SecroLoL
committed
Add UT for custom_scorer.py
SecroLoL
committed
Handle lowercase values for APIScorer initialization
SecroLoL
committed
Add UT for base_scorer.py
SecroLoL
committed
Add stricter typechecking in the ground_truth_to_examples and examples_to_ground_truth
SecroLoL
committed
Debug some UTs in the datasets utils
SecroLoL
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add UT for Data and Scorers library#26

Add UT for Data and Scorers library#26
JCamyre merged 30 commits intomainfrom
alex/add-unit-tests

Commits on Dec 24, 2024

remove post_init method from Example because it won't be called anyways. it's a BaseModel.

Merge remote-tracking branch 'origin/joseph/add-unit-tests' into alex/add-unit-tests

Add UT for data/example.py

Refactor to remove field variables from ProcessExample

Add UT for API Example

Add UT for data/result.py (ScoringResult)

Add UT for scorer_data.py script

Add UT for data/datasets/dataset.py

Assert that mock endpoints are called once

Add UT for data/datasets/ground_truth.py

Write UT for data/datasets/test_dataset_utils.py

Commits on Dec 25, 2024

Add UT for scorers/

Remove import for Example type hinting in custom_scorer.py to avoid circular imports.

Add UT for score.py functions a_safe_score_example and score_task

Add UT for score.py, TODO fix two of the failing test cases

Edit execute_with_semaphore() helper to prevent error propagation.

Add safe attribute checking for skipped scorers.

Fix two buggy tests for scoring utils functions.

Slight bufixes for the PromptScorer class: change _show_indicator to display_meter and make schema enforcement prompt use the actual type of the object instead of the raw name.

Add UT for PromptScorer code.

Add UT for custom_scorer.py

Handle lowercase values for APIScorer initialization

Add UT for base_scorer.py

Add stricter typechecking in the ground_truth_to_examples and examples_to_ground_truth

Debug some UTs in the datasets utils

Commits on Dec 27, 2024

Comment out the problematic logger unit testing.

Merge branch 'main' into alex/add-unit-tests

Update Pipfile to include missing packages. Rename TestScorer in unit tests because pytest was trying to use it as a Test class, but it can't because TestScorer inherited from a real class (with an…

Merge branch 'alex/add-unit-tests' of https://github.com/JudgmentLabs/judgeval into alex/add-unit-tests

Merge branch 'main' of https://github.com/JudgmentLabs/judgeval into alex/add-unit-tests

Add UT for Data and Scorers library#26JCamyre merged 30 commits intomainJudgmentLabs/judgeval:mainfrom alex/add-unit-testsJudgmentLabs/judgeval:alex/add-unit-testsCopy head branch name to clipboard

Commits

Commits on Dec 24, 2024

Commits on Dec 25, 2024

Commits on Dec 27, 2024

Add UT for Data and Scorers library#26
JCamyre merged 30 commits intomainfrom
alex/add-unit-tests