
The requirements surrounding ML infrastructure

Key challenges in "Deploy in production"Softwware Engineering Realtime or BatchCloud dvs Edge/BrowserCompute resources (CPU/GPU/memory)Latency, throug

AI system = Code(algorithem/model) + DataModel-centric AI deploymentData-centric AI deploymentKey Challenges - why low average error isn't good enough

Obtaining dataQuestion: How much data can we obtain in k days?Unless you know how many examples you need.Brainstorm list of data sources.Labeling data

Data-centric AI developmentA useful picture of data augmentationGetting more data with Cafe noise and improve the model can result in improvement on o

More label ambiguity examplesIs it a bot or spam account?Is it a fradulent transaction?Is he/she looking for job?Are the two users the same person? (n

What is scoping?Example: Ecommerce retailer looking to increase salesBetter recommender systemBetter searchImprove catalog dataInventory managementPri
MLflowTracking: 실험에서 사용된 코드, 파라미터, 메트릭 등 실험에서 생성되는 모든 결과를 기록하고 조회할 수 있음. Python, REST, R, JAVA API를 제공함.Project: 어떤 플랫폼에서도 실험이 재현 가능하도록 패키징하는 방법을 제공함.

Ways to run MLflow You can explicitly specify startrun() and endrun() Or you can use with to start and end the run Run ID: 4e24e3f695574503bd4

Logging hyper-parametres, metrics, artifacts, images and models Logging hyper-parametres Experiment ID: 446269725962928702 Run ID: 52f1730fe

Logging images and models Logging image files Name: MyFirstMLflow C:\Users\dof07\AppData\Local\Temp\ipykernel_8984\2191112145.py:48: UserWarning: No artists with labels found to put in lege...

Nested MLflow Runs For any child run, you have to specify nested=True Experiment ID: 838942086944409807 RUN ID parent: 339f8840eb8a40a68648e5214702cb50 RUN ID child1: 877588a82e0f4af2b63...

Custom Models When you are building your own custom model and it does not fit into any categories of modoling framework that MLflow provides, you can

Model Signiture with MLflow Model signiture is an object that allows us to specify the data type and shape that the model can work on. You can build a model signiture using mlflow.types.schema ...

mlflow.pyfunc as you are using a custom modelmodel_3 doubles the input and return as prediction

Centralized Model StoreModel LineageModel VersioningStage TransitionMOdel Annotations※ NOTE: As of 2025, stage has been removed from MLflow.The first

Creating a new version of the model(rft_modelx) with a new name called 'registered_model_1'It is basically registering a model if it is the first vers

Creating a new version of the model(rft_modelx) with a new name called 'registered_model_2'It is basically registering a model if it is the first vers