Metadata-Version: 2.3
Name: evalassist
Version: 0.1.26
Summary: EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other large language models by supporting users in iteratively refining evaluation criteria in a web-based user experience.
License: Apache-2.0
Keywords: LLM,evaluation,LLM-as-a-Judge,AI-evaluation
Author: Martín Santillán Cooper
Author-email: martinsantillancooper@gmail.com
Requires-Python: >=3.10,<3.14
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: Intended Audience :: End Users/Desktop
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Operating System :: OS Independent
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Text Processing :: Linguistic
Classifier: Framework :: FastAPI
Classifier: Framework :: Jupyter
Provides-Extra: benchmarks
Provides-Extra: dev
Provides-Extra: local-inference
Provides-Extra: postgresql
Provides-Extra: prometheus
Provides-Extra: webapp
Requires-Dist: GitPython ; extra == "dev"
Requires-Dist: accelerate ; extra == "local-inference"
Requires-Dist: alembic ; extra == "webapp"
Requires-Dist: bandit[standard,toml] ; extra == "dev"
Requires-Dist: boto3 ; extra == "webapp"
Requires-Dist: click ; extra == "webapp"
Requires-Dist: diskcache ; extra == "webapp"
Requires-Dist: fastapi ; extra == "webapp"
Requires-Dist: flake8 ; extra == "dev"
Requires-Dist: flake8-pytest-style ; extra == "dev"
Requires-Dist: httpx ; extra == "dev"
Requires-Dist: ibm_watsonx_ai ; extra == "webapp"
Requires-Dist: langchain
Requires-Dist: litellm ; extra == "webapp"
Requires-Dist: nbconvert ; extra == "webapp"
Requires-Dist: nbformat ; extra == "webapp"
Requires-Dist: nest_asyncio ; extra == "webapp"
Requires-Dist: ollama ; extra == "webapp"
Requires-Dist: openai ; extra == "webapp"
Requires-Dist: pandas ; extra == "webapp"
Requires-Dist: pre_commit ; extra == "dev"
Requires-Dist: prometheus-eval ; extra == "prometheus"
Requires-Dist: psycopg2-binary ; extra == "postgresql"
Requires-Dist: pydantic
Requires-Dist: pytest ; extra == "dev"
Requires-Dist: pytest-cov ; extra == "dev"
Requires-Dist: scikit-learn ; extra == "benchmarks"
Requires-Dist: setuptools ; extra == "webapp"
Requires-Dist: sqlmodel ; extra == "webapp"
Requires-Dist: tenacity ; extra == "webapp"
Requires-Dist: torch ; extra == "local-inference"
Requires-Dist: tox ; extra == "dev"
Requires-Dist: transformers ; extra == "local-inference"
Requires-Dist: unitxt (>=1.26.6)
Requires-Dist: uvicorn ; extra == "webapp"
Requires-Dist: vllm ; extra == "prometheus"
Project-URL: Bug Tracker, https://github.com/IBM/eval-assist/issues
Project-URL: Documentation, https://github.com/IBM/eval-assist/wiki
Project-URL: Homepage, https://ibm.github.io/eval-assist/
Project-URL: Repository, https://github.com/IBM/eval-assist
