Implement Prediction API
Problem to solve
As Mantik user
, I want to use send data to a deployed model
so that I can use it for inference
.
Further details
- API schemata can be found here
- A definition of the relevant data structures can be found here, and here
- This story probably involves little to no database tasks
- You can assume that our API just forwards requests to the deployed model and forwards responses back to the original caller
Proposal
-
Implement backend logic using the stubs that refer to the Prediction API: -
Forward incoming PredictionRequests to the deployed model -
Forward returned PredictionResponses to the original caller -
Implement error handling response if deployed model is not found
-
Testing
- Use fastapi testing submodule to test API calls.
- Use automation that is available for testing.
- Unit test coverage >90%
What does success look like, and how can we measure that?
-
Predictions API is implemented
Edited by Fabian Emmerich