Skip to main content

Entity Detection

The Entity Detection model lets you automatically identify and categorize key information in transcribed audio content.

Here are a few examples of what you can detect:

  • Names of people
  • Organizations
  • Addresses
  • Phone numbers
  • Medical data
  • Social security numbers

For the full list of entities that you can detect, see Supported entities.

Supported languages

Entity Detection is available in multiple languages. See Supported languages.


Enable Entity Detection by setting entity_detection to true in the transcription config.

Example output

Timestamp: 2548 - 3130

the US
Timestamp: 5498 - 6350


API reference


curl \
--header "Authorization: YOUR_API_KEY" \
--header "Content-Type: application/json" \
--data '{
"audio_url": "YOUR_AUDIO_URL",
"entity_detection": true
entity_detectionbooleanEnable Entity Detection.


entitiesarrayAn array of detected entities.
entities[i].entity_typestringThe type of entity for the i-th detected entity.
entities[i].textstringThe text for the i-th detected entity.
entities[i].startnumberThe starting time, in milliseconds, at which the i-th detected entity appears in the audio file.
entities[i].endnumberThe ending time, in milliseconds, for the i-th detected entity in the audio file.

The response also includes the request parameters used to generate the transcript.

Supported entities

The model is designed to automatically detect and classify various types of entities within the transcription text. The detected entities and their corresponding types is listed individually in the entities key of the response object, ordered by when they first appear in the transcript.

account_numberCustomer account or membership identification numberPolicy No. 10042992; Member ID: HZ-5235-001
banking_informationBanking information, including account and routing numbers
blood_typeBlood typeO-, AB positive
credit_card_cvvCredit card verification codeCVV: 080
credit_card_expirationExpiration date of a credit card
credit_card_numberCredit card number
dateSpecific calendar dateDecember 18
date_intervalBroader time periods, including date ranges, months, seasons, years, and decades2020-2021; 5-9 May; January 1984
date_of_birthDate of birthDate of Birth: March 7,1961
drivers_licenseDriver's license number.DL# 356933-540
drugMedications, vitamins, or supplementsAdvil, Acetaminophen, Panadol
durationPeriods of time, specified as a number and a unit of time8 months; 2 years
eventName of an event or holidayOlympics, Yom Kippur
filenameNames of computer files, including the extension or filepathTaxes/2012/brad-tax-returns.pdf
gender_sexualityTerms indicating gender identity or sexual orientation, including slang termsfemale; bisexual; trans
healthcare_numberHealthcare numbers and health plan beneficiary numbersPolicy No.: 5584-486-674-YM
injuryBodily injuryI broke my arm, I have a sprained wrist
ip_addressInternet IP address, including IPv4 and IPv6 formats192.168.0.1
languageName of a natural languageSpanish, French
locationAny Location reference including mailing address, postal code, city, state, province, country, or coordinates.Lake Victoria, 145 Windsor St., 90210
marital_statusTerms indicating marital statusSingle; common-law; ex-wife; married
medical_conditionName of a medical condition, disease, syndrome, deficit, or disorderchronic fatigue syndrome, arrhythmia, depression
medical_processMedical process, including treatments, procedures, and testsheart surgery, CT scan
money_amountName and/or amount of currency15 pesos, $94.50
nationalityTerms indicating nationality, ethnicity, or raceAmerican, Asian, Caucasian
number_sequenceNumerical PII (including alphanumeric strings) that doesn't fall under other categories
occupationJob title or professionprofessor, actors, engineer, CPA
organizationName of an organizationCNN, McDonalds, University of Alaska, Northwest General Hospital
passport_numberPassport numbers, issued by any countryPA4568332; NU3C6L86S12
passwordAccount passwords, PINs, access keys, or verification answers27%alfalfa, temp1234, My mother's maiden name is Smith
person_ageNumber associated with an age27, 75
person_nameName of a personBob, Doug Jones, Dr. Kay Martinez, MD
phone_numberTelephone or fax number
physical_attributeDistinctive bodily attributes, including terms indicating raceI'm 190cm tall; He belongs to the Black students' association
political_affiliationTerms referring to a political party, movement, or ideologyRepublican, Liberal
religionTerms indicating religious affiliationHindu, Catholic
statisticsMedical statistics18%, 18 percent
timeExpressions indicating clock times19:37:28; 10pm EST
urlInternet addresses
us_social_security_numberSocial Security Number or equivalent
usernameUsernames, login names, or handles@AssemblyAI
vehicle_idVehicle identification numbers (VINs), vehicle serial numbers, and license plate numbers5FNRL38918B111818; BIF7547
zodiac_signNames of Zodiac signsAries; Taurus

Frequently asked questions

How does the Entity Detection model handle misspellings or variations of entities?

The model is capable of identifying entities with variations in spelling or formatting. However, the accuracy of the detection may depend on the severity of the variation or misspelling.

Can the Entity Detection model identify custom entity types?

No, the Entity Detection model doesn't support the detection of custom entity types. However, the model is capable of detecting a wide range of predefined entity types, including people, organizations, locations, dates, times, addresses, phone numbers, medical data, and banking information, among others.

How can I improve the accuracy of the Entity Detection model?

To improve the accuracy of the Entity Detection model, it's recommended to provide high-quality audio files with clear and distinct speech. In addition, it's important to ensure that the audio content is relevant to the use case and that the entities being detected are relevant to the intended analysis. Finally, it may be helpful to review and adjust the model's configuration parameters, such as the confidence threshold for entity detection, to optimize the results.