Upload
others
View
9
Download
0
Embed Size (px)
Citation preview
Technology that can perceive, learn, reason, assist in decision making, and act to help us solve problems.
Geoffrey Hinton
“The next Einstein will
be a combination of
people and machines.”
Miguel G. Corral | @miguelgcorral
Artificial Intelligence
(simulating human intelligence)
Robotics
(hardware, mechanics)
Scary, but far in the future
Less scary, practical and now!
Cognitive Services
(custom vision, NLP,
search, etc)
Machine learning
(tools/algorithms)
Deep learning
(one type of
ML algorithm)
Valu
e
• Complete a cloud native platform.
• Create organization that develops and runs the cloud platform
• Integrate with current IT
• Bring additional workloads live
• Establish workload management (intakes, backlog, priorities) SCALE
Visible AIMatureFoundational AspirationalApproaching
I don’t understand my data and my model
It’s difficult to retrain my old model
My enterprise compliance standards require the highest levels of X
It’s difficult to replicate the training environment in the model hosting environment
It’s difficult to scale up and out with really large workloads
It’s difficult to ingest, track and leverage my data
It’s hard to get started with AI
There are many personas
and ways to do ML
It is hard to integrate AI into my existing processes
Time
Explainable Autonomous AI Systems
No expert machine-
learning requiredAll it takes is an API call to
embed AI
{
"status": "Succeeded",
"succeeded": true,
"failed": false,
"finished": true,
"recognitionResults": [
{
"page": 1,
"clockwiseOrientation": 358.85,
"width": 1000,
"height": 945,
"unit": "pixel",
"lines": [
{
"boundingBox": [
249,
268,
671,
259,
672,
308,
250,
316
],
"text": "You must be the change you",
"words": [
{
"boundingBox": [
259,
268,
307,
267,
310,
The most comprehensive pre-trained AI
Web search
Bing Autosuggest
Give your app intelligent autosuggest options for searches
Bing Search
Web SearchImage SearchNews SearchVideo Search
Create a highly-customized web search experience
Enrich user experiences with contextual entity search results
Bing Entity Search
Bing Custom Search
Bing Visual Search
Get rich insights to help build
compelling image applications on
the device of your choice
Find local business results in your place of interest
Bing Local Business Search
The most comprehensive pre-trained AI
Vision
Custom Vision
Video Indexer
Process and extract smart insights from videos
Customizable web service that learns to recognize
specific content in imagery
Computer Vision
Distill actionable information from images
Face
Detect, identify, analyze, organize, tag faces in photos, and even recognize emotions
Ink Recognizer
Recognize digital ink and handwriting
Form Recognizer
Extract text, key-value pairs, and tables from documents
The most comprehensive pre-trained AI
Language
Language Understanding
Teach your apps to understand commands from your users
Text Analytics
Detect sentiment, key phrases, language, and extract
top entities from your text
Bing Spell Check
Detect and correct spelling mistakes within your app
Easily perform speech and text translation
Translator Text
QnA Maker
Distill information into conversational, easy-to-
navigate answers
Inmersive Reader
Embed inclusive capabilities into your apps for users
regardless of age or ability
The most comprehensive pre-trained AI
Speech
Speaker Recognition
Use speech to identify and
verify individual speakers
Speech CustomizationSpeech Service
The customization capabilities of Speech
Services can help you improve the
accuracy of speech services.
Unified Speech service for general
use:
Speech-To-Text
Text-To-Speech
Translator Speech
Custom Speech
Custom Voice
Custom Translator
The most comprehensive pre-trained AI
Decision
Anomaly Detector
Monitor business health in real-time
Conduct IoT-remote monitoring
Content Moderator
Machine-assisted moderation of text and images, augmented
with human review tools
Personalizer
Deliver rich personalized experiences in your apps
Metrics Advisor
Protect your organization’s growth
by proactively monitoring metrics
and diagnosing issues
Root-cause analysis
Anomaly detection
Personalization
Sentiment analysis
Intent understanding
Text and document translation
Q & A creation
Speaker recognition
Speech to text
Entity extraction
Vision Speech Language Decision
Metric monitoring
Image understanding
Image captioning
Video indexing
Text extraction
Facial recognition
Form recognition
Spatial analysis
Text to speech
Custom neural voices
Speech translation
Content Moderator
Anomaly Detector
Personalizer
Language Understanding
Text Analytics
Text and document Translation
QnA Maker
Speaker Recognition
Speech
Customizable
Immersive Reader
Vision Speech Language Decision
Metrics Advisor
Computer Vision
Face
Video Indexer
Custom Vision
Form Recognizer
Deploy anywhere using containers
Azure Cognitive Services Wherever your data resides
Vision Speech
Language Decision
Improve interaction
between people and
processes
Extend human capacity
and knowledge for
decision making
Simplify and
optimize repetitive
tasksInteraction Amplify Automation
Impact of Cognitive Services
AI is here to help Text
(1) Validate enrichment pipeline
Tags
“throwing”, “ball”, “girl”, “grass”, “basketball”
Caption
“A girl throwing a ball”
Entities:Person(s)“Anita Christiansen”,“Conrad Nuber”,
Location(s) “Bothell”, “Woodinville”
Organization(s) “Litware Insurance Corp.”
Going beyond Search
0 Results Any time
I’m sorry… this isn’t a question that can be answered with search….
Show change in price over time
management free
keyword search
faceting
language analyzers
geospatial support
suggestions/auto-complete
customizable scoring
proximity search
synonyms
complex types
etc.
Azure Cognitive Search
Search-as-a-Service
At a high level…
Data in any format,
any Azure store
Annotations
Cognitive skills Search
Ingest Enrich Explore
Cognitive Search Architecture
Customer
Data
Document Cracking
Third Party Enrichers
Cognitive
Skill
Annotated
Documents
Indexing
For Search
Search
Index
Cognitive Search Architecture
Customer
Data
Document Cracking
Third Party Enrichers
Cognitive
Skill
Annotated
Documents
Indexing
For Search
Search
Index
Document Cracking
Different types of data sources Azure Blob Storage
Azure SQL
Azure Cosmos DB
Azure Table Storage
ADLS Gen2
File formats supported in blob storage PDF
Microsoft Office formats: DOCX/DOC, XLSX/XLS, PPTX/PPT,
MSG (Outlook emails)
HTML
XML
ZIP
EML
RTF
Plain text files (see also Indexing plain text)
JSON (see Indexing JSON blobs)
CSV (see Indexing CSV blobs preview feature)
Text
Images
Metadata
Cognitive Search Architecture
Customer
Data
Document Cracking
Third Party Enrichers
Cognitive
Skill
Annotated
Documents
Indexing
For Search
Search
Index
Built-in Cognitive SkillsOCR, Key Phrase Extraction, People Names,
Company Names, Sentiment Analyzer, Computer
Vision, etc.
Third Party EnrichersCustom classification models, Custom entity
extraction, etc.
Natural Language ProcessingKey Phrase Extraction Sentiment AnalysisOrganization Entity ExtractionLocation Entity Extraction Persons Entity ExtractionLanguage DetectionText Translation
Image ProcessingFace DetectionTag ExtractionCelebrity RecognitionLandmark DetectionHandwriting RecognitionPrinted Text Recognition
UtilitiesComplex Type ShapingText MergingText SplittingConditional Skill
Built-in Skills in
Multiple
Languages
content
normalized
images
language
tags
orgscontent
content
SkillsetYou can create enrichment chains
…,
{
"@odata.type": "#Microsoft.Skills.Text.NamedEntityRecognitionSkill",
"categories": [ "Organization" ],
"defaultLanguageCode": "en",
"inputs": [
{ "name": "text", "source": "/document/content" },"name" "languageCode" "source" "/document/myLanguageCode"
],"outputs":[
{ "name": "organizations", "targetName": "organizations" }
]
},
Skillset
content
normalized
images
language
tags
orgscontent
content
SkillsetYou can create enrichment chains
…,
{
"@odata.type": "#Microsoft.Skills.Custom.WebApiSkill",
"uri" "https://myskill.azurewebsites.net/api/OrgId"
"context": "/document/organizations/*" ,
"httpHeaders": {"Api-Key": "mySecret" },
"inputs": [
{ "name": “organizationName", "source": "/document/organizations/*" },
],"outputs":[
{ "name": "organizationId", "targetName": "organizationId" }
]
},
Skillset
{
"values": [
{
"recordId": "7cad2",
"data":
{
"myOuput1": “animals"
}
},
{
"recordId": "7cad3",
"data":
{
"myOutput1": “colors"
}
},
…
]
}
{
"values": [
{
"recordId": "7cad2",
"data":
{
"myInput1": "fox","myInput2": "cat",
}
},
{
"recordId": "7cad3",
"data":
{
"myInput1": "blue",
"myInput2": "red",
}
},
…
]
}
Extend with your own skills…Well defined input/output schema
Built-in skills
Location entity extraction
Persons entity extraction
Celebrity recognition
Landmark detection
Sentiment analysis
Language detection
Image tag extraction
Printed text recognition
Key Phrase extraction
Organization entity extraction
Face detection
Text Utilities Azure Databricks
Machine LearningVMs
Azure Machine Learning
Custom skills
Your custom
skill goes here!
Cognitive Search Architecture
Customer
Data
Document Cracking
Third Party Enrichers
Cognitive
Skill
Annotated
Documents
Indexing
For Search
Search
Index
New Indexer Property
{…"outputFieldMappings": [
{"sourceFieldName":
"/document/organizations/*/organizationId","targetFieldName":
"orgIds"} ,…
] }
Cognitive Search Architecture
Customer
Data
Document Cracking
Third Party Enrichers
Cognitive
Skill
Annotated
Documents
Indexing
For Search
Search
Index
Knowledge
Store
Ingest Extract
experience 2
3
1
document
primaryImage
secondaryImage
job
company
duration
job
company
duration
job
company
duration
Ingest
Candidates with 5 years experience
Extract Search
experience 2
3
1
document
primaryImage
secondaryImage
job
company
duration
job
company
duration
job
company
duration
Candidates with 5 years experience
Ingest Extract Search
Knowledge store
Store
experience 2
3
1
document
primaryImage
secondaryImage
job
company
duration
job
company
duration
job
company
duration
Predict with Azure
Machine Learning
Infuse into your applications
Visualize with Power BI
Extract Store
experience 2
3
1
document
primaryImage
secondaryImage
job
company
duration
job
company
duration
job
company
duration
Ingest
Knowledge store