PinnedPublished inArtificial Intelligence in Plain EnglishMy 2024 Oxford ML Summer School ExperienceI had an incredible growth experience in July at the Oxford Machine Learning Summer School.Oct 7, 2024Oct 7, 2024
Published inTowards Data EngineeringTrigger Airflow DAG with REST API from SnowflakeIn an earlier article I wrote about How to Trigger Airflow DAG Using REST API. I extend the concept here with Snowflake and LambdaDec 27, 2024Dec 27, 2024
Published inAI AdvancesText-to-SQL LLM App with Snowflake CortexEmpower business users with chat assistant that takes their regular questions in English to query a database. I include a bonus too!Dec 16, 2024Dec 16, 2024
Published inArtificial Intelligence in Plain EnglishSpeed Up Bulk Loading into DynamoDB with S3 and Parallel LambdasIf you ever need to bulk load data into DynamoDB, perhaps for your training or inference pipeline, you might quickly discover how slow it…Dec 9, 2024Dec 9, 2024
Published inTowards Data EngineeringExternalTaskSensor vs TriggerDagRunOperatorI have been exploring airflow sensors and deferrable operators in my recent articles. This article explores two often confused operators.Sep 28, 2024Sep 28, 2024
Published inArtificial Intelligence in Plain EnglishCreate AI Assistant in Slack with LMStudioA beginner AI assistant hands-on project with Gemma LLM running locally in LM Studio and accessed via Slack.Sep 23, 20241Sep 23, 20241
Solve Stable Marriage Problem with Gale-Shapley AlgorithmPython implementation of the Gale-Shapley algorithm for the stable matching problemSep 21, 2024Sep 21, 2024
Published inTowards Data EngineeringCreate Event Driven Airflow Pipeline with SNS, SQS and LambdaHow I set up a simple demo to use AWS SNS/SQS with Lambda to trigger Airflow DAGs with message content as parametersSep 18, 2024Sep 18, 2024
Published inTowards Data EngineeringCreate Event Driven Airflow Pipeline with Amazon SQSI have been thinking about making Airflow pipelines more event driven and wondering how Amazon’s SQS could facilitate that. Partly I would…Sep 14, 2024Sep 14, 2024
