Metadata-Version: 2.1
Name: trism
Version: 0.0.1.post1
Summary: Inference with Triton Inference Server easily.
Home-page: https://github.com/hieupth/trismid
Author: Hieu Pham
Author-email: 64821726+hieupth@users.noreply.github.com
License: GNU AGPL v3.0
Classifier: Intended Audience :: Developers
Classifier: Topic :: Software Development :: Build Tools
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: pinecore

# Triton Inference Server Model
Simple package to run inference with Triton Inference Server easily.
```bash
pip install trism
# Or
pip install https://github.com/hieupth/trism
```
## How to use
```python
# Create triton model.
model = TritonModel(
  model="my_model",     # Model name.
  version=0,            # Model version.
  url="localhost:8001", # Triton Server URL.
  grpc=True             # Use gRPC or Http.
)
# View metadata.
for inp in model.inputs:
  print(f"name: {inp.name}, shape: {inp.shape}, datatype: {inp.dtype}\n")
for out in model.outputs:
  print(f"name: {out.name}, shape: {out.shape}, datatype: {out.dtype}\n")
# Inference.
outputs = model.run(data = [np.array(...)])
```
## License
[GNU AGPL v3.0](LICENSE).<br>
Copyright &copy; 2024 [Hieu Pham](https://github.com/hieupth). All rights reserved.
