https://kythuatdulieu.github.io/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/byzantine-fault-tolerance/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/cap-theorem/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/consensus-raft-paxos/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/data-engineer-role/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/data-engineering/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/data-fabric/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/data-lifecycle/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/data-mesh/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/data-pipeline/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/data-platform-architecture/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/data-warehouse/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/event-driven-architecture/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/feature-store/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/file-formats/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/gossip-protocol-vector-clocks/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/gossip-protocol/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/kappa-architecture/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/lambda-architecture/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/leader-election/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/modern-data-stack/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/pacelc-theorem/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/push-pull-delivery/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/real-time-architecture/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/relational-database/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/source-systems/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/storage-compute-decoupling/https://kythuatdulieu.github.io/concepts/1-distributed-systems-architecture/zero-copy-cloning/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/backfill/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/backpressure-handling/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/change-data-capture/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/data-extraction/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/data-ingestion/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/data-loading/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/data-transformation/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/deduplication/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/elt/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/etl/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/idempotency/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/incremental-load/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/log-based-cdc-internals/https://kythuatdulieu.github.io/concepts/2-data-ingestion-integration/webhook-idempotency/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/acid-transactions-on-lake/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/amazon-redshift/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/apache-hudi/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/apache-iceberg/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/azure-synapse/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/b-tree-vs-lsm-tree/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/bloom-filters-sstables/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/cloud-storage/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/clustering/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/columnar-storage/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/compaction/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/compression-algorithms/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/data-lake/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/databricks-platform/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/delta-lake/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/delta-optimistic-concurrency/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/delta-optimize-vacuum/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/file-formats-deep-dive/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/google-bigquery/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/iceberg-small-files-compaction/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/iceberg-snapshot-isolation/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/indexing/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/lakehouse/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/liquid-clustering-deep-dive/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/medallion-architecture/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/olap/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/oltp-vs-olap-storage/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/oltp/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/parquet-internals/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/partitioning/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/schema-evolution/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/serverless-data/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/snowflake/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/table-format/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/time-series-databases/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/time-travel/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/vacuum-autovacuum-mechanisms/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/vector-database/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/vector-store/https://kythuatdulieu.github.io/concepts/3-storage-engines-formats/z-order-deep-dive/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/apache-spark/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/batch-processing/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/data-skew/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/distributed-joins-mechanisms/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/distributed-processing/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/mpp-architecture-dremel/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/shuffle/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/spark-aqe-adaptive-query/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/spark-catalyst-optimizer/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/spark-data-skew-salting/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/spark-execution-model/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/spark-jobs-stages-tasks/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/spark-joins/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/spark-partition/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/spark-spill-to-disk/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/spark-sql/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/spark-tungsten-engine/https://kythuatdulieu.github.io/concepts/4-compute-engines-batch/troubleshooting-spark-oom/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/apache-kafka/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/chandy-lamport-checkpointing/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/consumer-groups/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/event-time-processing-time/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/exactly-once-semantics/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/flink-backpressure/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/flink-rocksdb-state-backend/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/flink-watermarks-late-data/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/kafka-consumer-lag-rebalance/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/kafka-exactly-once-semantics/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/kafka-topics-partitions/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/stream-table-duality/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/streaming-processing/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/watermark/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/windowing/https://kythuatdulieu.github.io/concepts/5-stream-processing-realtime/zero-copy-principle/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/data-contract/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/data-vault-modeling/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/dbt-models/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/dbt/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/dimension-table/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/dimensional-modeling/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/fact-table/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/grain/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/inmon-methodology/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/kimball-methodology/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/materialization/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/metrics-layer/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/one-big-table-obt/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/slowly-changing-dimension/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/snowflake-schema/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/sql-transformation/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/star-schema/https://kythuatdulieu.github.io/concepts/6-data-modeling-transformation/surrogate-key/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/airflow-celery-vs-k8s-executor/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/airflow-scheduler/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/airflow-zombie-tasks/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/alerting-incident-response/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/anomaly-detection/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/apache-airflow/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/blue-green-deployment-data/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/circuit-breakers-data/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/dag/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/data-observability/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/data-profiling/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/data-quality-dimensions/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/data-quality/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/data-reconciliation/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/data-testing/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/dataops/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/dbt-testing/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/distribution-drift/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/freshness-monitoring/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/orchestration/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/retries-sla/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/root-cause-analysis/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/schema-drift/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/sensors/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/software-defined-assets/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/task-dependency/https://kythuatdulieu.github.io/concepts/7-dataops-orchestration-quality/volume-anomalies/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/access-control/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/audit-logging/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/cost-optimization/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/data-catalog/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/data-classification/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/data-governance/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/data-lineage/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/data-masking-encryption/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/data-ownership/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/finops-data-engineering/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/metadata-management/https://kythuatdulieu.github.io/concepts/8-security-governance-finops/unity-catalog/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/ai-agent/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/chunking-strategy/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/chunking/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/context-window/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/embedding-model/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/embedding-models/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/embeddings/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/evaluation-metric/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/few-shot-prompting/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/few-shot/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/fine-tuning/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/hallucination/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/hybrid-search/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/llm-as-a-judge/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/llm/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/lora/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/mlflow/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/model-serving/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/ndcg/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/peft/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/prompt-engineering/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/rag/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/recall/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/reranker/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/reranking/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/rlhf/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/row-based-storage/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/semantic-search/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/system-prompt/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/temperature/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/token/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/top-p/https://kythuatdulieu.github.io/concepts/9-genai-machine-learning/zero-shot/https://kythuatdulieu.github.io/interview/cloud-platform-interview/https://kythuatdulieu.github.io/interview/data-modeling-interview/https://kythuatdulieu.github.io/interview/de-behavioral-interview/https://kythuatdulieu.github.io/interview/kafka-design-interview/https://kythuatdulieu.github.io/interview/overview/https://kythuatdulieu.github.io/interview/performance-tuning-qa/https://kythuatdulieu.github.io/interview/pipeline-design-interview/https://kythuatdulieu.github.io/interview/production-incident-qa/https://kythuatdulieu.github.io/interview/python-de-interview/https://kythuatdulieu.github.io/interview/spark-optimization-interview/https://kythuatdulieu.github.io/interview/sql-interview-patterns/https://kythuatdulieu.github.io/learning-paths/core-paths/beginner-de/https://kythuatdulieu.github.io/learning-paths/core-paths/de-career-paths/https://kythuatdulieu.github.io/learning-paths/core-paths/junior-to-middle-de/https://kythuatdulieu.github.io/learning-paths/core-paths/middle-to-senior-de/https://kythuatdulieu.github.io/learning-paths/interview-prep/https://kythuatdulieu.github.io/learning-paths/leadership-culture/big-tech-vs-startups/https://kythuatdulieu.github.io/learning-paths/leadership-culture/boring-data-engineering/https://kythuatdulieu.github.io/learning-paths/leadership-culture/de-traits-and-mindset/https://kythuatdulieu.github.io/learning-paths/leadership-culture/on-call-survival-guide/https://kythuatdulieu.github.io/learning-paths/leadership-culture/post-mortems-culture/https://kythuatdulieu.github.io/learning-paths/leadership-culture/proving-data-roi/https://kythuatdulieu.github.io/learning-paths/leadership-culture/writing-design-docs-rfc/https://kythuatdulieu.github.io/learning-paths/overview/https://kythuatdulieu.github.io/learning-paths/specializations/analytics-engineer/https://kythuatdulieu.github.io/learning-paths/specializations/cloud-data-engineer/https://kythuatdulieu.github.io/learning-paths/specializations/data-platform-engineer/https://kythuatdulieu.github.io/learning-paths/specializations/streaming-data-engineer/https://kythuatdulieu.github.io/projects/e2e/ecomlake/https://kythuatdulieu.github.io/projects/e2e/fabric-metadata-framework/https://kythuatdulieu.github.io/projects/e2e/kafka-spark-airflow/https://kythuatdulieu.github.io/projects/e2e/movie-analytics-pipeline/https://kythuatdulieu.github.io/projects/e2e/reddit-data-pipeline/https://kythuatdulieu.github.io/projects/e2e/showpulse-ticketmaster/https://kythuatdulieu.github.io/projects/e2e/snowflakedemo/https://kythuatdulieu.github.io/projects/e2e/spark-data-lakehouse/https://kythuatdulieu.github.io/projects/e2e/streamify-pipeline/https://kythuatdulieu.github.io/projects/system-design/airbnb-dynamic-pricing/https://kythuatdulieu.github.io/projects/system-design/data-mesh-vs-data-fabric/https://kythuatdulieu.github.io/projects/system-design/distributed-caching-strategies/https://kythuatdulieu.github.io/projects/system-design/finops-architecture/https://kythuatdulieu.github.io/projects/system-design/idempotency-in-data-pipelines/https://kythuatdulieu.github.io/projects/system-design/lambda-vs-kappa-architecture/https://kythuatdulieu.github.io/projects/system-design/modern-vs-post-modern-data-stack/https://kythuatdulieu.github.io/projects/system-design/netflix-recommendation-architecture/https://kythuatdulieu.github.io/projects/system-design/rate-limiting-data-apis/https://kythuatdulieu.github.io/projects/system-design/uber-log-analytics-case-study/