Clarify
What does Clarify do?
aipractitioner
Evaluate FMs, Explain FM inferences, detect Bias in a FM
Clarify
Example of Clarify evaluating a FM?
aipractitioner
Tell you if inferences from the model are friendly (human factor)
Clarify
How does Clarify tell if your FM is friendly (for example)?
aipractitioner
Uses humans to evaluate inferences
Clarify
Where do the humans come from?
aipractitioner
Use an AWS-managed team or bring your own humans
Clarify
What is Clarify Explainability?
aipractitioner
Show what Features (input data type/values) contributed to the model answering the way it did
Clarify
How does Clarify detect Bias?
aipractitioner
Start a job and give it the columns/features to look at. Clarify uses statistics to tell if there is any Bias.
Ground Truth
Tag line for SageMaker Ground Truth?
aipractitioner
Data-labeling service, create high-quality datasets for training models
Ground Truth
What does Ground Truth do?
aipractitioner
Review your model, help customize it for human preferences.
Ground Truth
What types of data can Ground Truth handle?
aipractitioner
Text, images, videos
Ground Truth
What big learning thing is associted with Ground Truth?
aipractitioner
RLHF: Reinforcement Learning from Human Feedback
Ground Truth
Where do the human reviewers come from?
aipractitioner
Your employees or Mechanical Turk
Governance
What are SageMaker Model Cards?
aipractitioner
Overview of each model with intended uses, risks, and other details
Governance
What is SageMaker Model Dashboard?
aipractitioner
Central repo for all models with details on each
Governance
What is SageMaker Role Manager?
aipractitioner
Set permissions inside SageMaker for each type of human in your company (data scientist, …)
Governance
What is SageMaker Model Monitor?
aipractitioner
Watch your model’s inferences and alert you when teh model quality drops
so you can re-train it, for example
JumpStart
What is SageMaker JumpStart?
aipractitioner
Find and deploy models with a couple clicks (no big SageMaker training)
JumpStart
Why is JumpStart different than Bedrock?
aipractitioner
JumpStart has more models, some specalized. Bedrock is more about LLMs.
JumpStart
How do you deploy a model on JumpStart?
aipractitioner
Just like anything else in SageMaker: creates a SageMaker deployment with an Endpoint in a VPC.
Other Stuff
What is SageMaker Canvas?
aipractitioner
No-code, visual way to prepare data, train, and deploy models.
Other Stuff
What is SageMaker Pipelines?
aipractitioner
Just like dev pipelines: automate all the steps for model building, training, and deployment
Other Stuff
What is mlflow?
aipractitioner
3rd party open-source tool, integrated into SageMaker
Other Stuff
What is SageMaker DeepAR?
aipractitioner
Forecasting algorithm used to forecast time series data
-
Agents3
-
AI, ML, DL27
-
Concepts27
-
Fine Tuning20
-
Fit19
-
Guardrails5
-
Model Evaluation (1)21
-
Model Evaluation (2)30
-
Pricing15
-
Prompt Engineering (1)19
-
Prompt Engineering (2)19
-
Q Business20
-
RAG6
-
Responsible AI15
-
Training32
-
Auto ML21
-
Comprehend23
-
Rekognition12
-
SageMaker (1)17
-
SageMaker (2)22
-
Transcribe11
-
Confusion Matrix27
-
to_add_somewhere_130
-
to_add_somewhere_233
-
to_add_somewhere_328
