distilbert-base-uncased-distilled-squad
DistilBERT is a small, fast, cheap and light Transformer model trained by distilling BERT base. It has 40% less parameters than bert-base-uncased, runs 60% faster while preserving over 95% of BERT's performances as measured on the GLUE language understanding benchmark. This model is a fine-tune checkpoint of DistilBERT-base-uncased, fine-tuned using (a second step of) knowledge distillation on SQuAD v1.1.
DistilBERT is a small, fast, cheap and light Transformer model trained by distilling BERT base. It has 40% less parameters than bert-base-uncased, runs 60% faster while preserving over 95% of BERT's performances as measured on the GLUE language understanding benchmark. This model is a fine-tune checkpoint of DistilBERT-base-uncased, fine-tuned using (a second step of) knowledge distillation on SQuAD v1.1.
HTTP/cURL API
You can use cURL or any other http client to run inferences:
curl -X POST \
-d '{"question": "Who jumped?", "context": "The quick brown fox jumped over the lazy dog."}' \
-H "Authorization: bearer $DEEPINFRA_TOKEN" \
-H 'Content-Type: application/json' \
'https://api.deepinfra.com/v1/inference/distilbert-base-uncased-distilled-squad'
which will give you back something similar to:
{
"answer": "fox",
"score": 0.1803228110074997,
"start": 16,
"end": 19,
"request_id": null,
"inference_status": {
"status": "unknown",
"runtime_ms": 0,
"cost": 0.0,
"tokens_generated": 0,
"tokens_input": 0
}
}
Input fields
webhookfile
The webhook to call when inference is done, by default you will get the output in the response of your inference request
