Tag

Data Engineering

57 posts9 years

2023

Apache OpenDAL in Rust to Access Any Kind of Data Services

Rust

DuckDB

Data

Airflow control the parallelism and concurrency (draw)

Data

Fossil Data Platform Rewritten in Rust 🦀

Rust

Running Spark in GitHub Actions

Data

GPT vs Traditional NLP Models

Data

Ask ChatGPT about 20 important concepts of Apache Spark

Data

Rust Data Engineering: Processing Dataframes with Polars

Rust

Data Engineering Tools written in Rust

Data

Why ClickHouse Should Be the Go-To Choice for Your Next Data Platform?

Data

2022

Airflow Dataset (Data-aware scheduling)

Data

Spark on Kubernetes tại Fossil 🤔

Data

Manage Redshift/Postgres Privileges GitOps Style

Data

2021

Rust và Data Engineering? 🤔

Data

Spark on Kubernetes - better handling for node shutdown

Data

Uptime with GitHub Actions

Productivity

From Docker to Podman on MacOS

Productivity

Good reasons to use ClickHouse

Data

zx

Productivity

Bitbucket Pipelines Notes

Productivity

Postgres Full Text Search

Data

Spark on Kubernetes Performance Tuning

Data Engineering

2020

Airflow 2.0 - Taskflow API

Data Engineering

Tại sao nên triển khai Apache Spark trên Kubernetes

Data Engineering

Scheduling Python script in Airflow

Data Engineering

Spark History Server on Kubernetes

Data Engineering

3 ways to run Spark on Kubernetes

Data Engineering

Airflow DAG Serialization

Data Engineering

Data Studio: Connecting BigQuery and Google Sheets to help with hefty data analysis

Data Engineering

2019

Đánh giá hệ thống Information Retrieval (tiếp theo)

Data Engineering

Sách hay (Engineering)

Data Engineering

Đánh giá hệ thống Information Retrieval

Data Engineering

Information Retrieval - Vector Space Model

Data Engineering

Airflow - một số ghi chép

Data Engineering

Cài đặt Apache Airflow với Docker Compose

Data Engineering

Gửi Slack Alerts trên Airflow

Data Engineering

Airflow - "context" dictionary

Data Engineering

Guess.js

Javascript

2018

[Slide] Build simple data pipeline for ETL and data aggregation on AWS

Data Engineering

Deploy Deep Learning model as a web service API

Machine Learning

Sử dụng PyTorch với GPU miễn phí trên Google Colab

Machine Learning

Propel - Machine learning for Javascript

Machine Learning

Duckling - phân tích văn bản sang dữ liệu có cấu trúc

Machine Learning

2017

Colaboratory - phiên bản custom của Jupyter Notebook từ Google

Web

Python - Nhận dạng xe hơi với OpenCV

Machine Learning

Phân lớp văn bản

Machine Learning

natural - NLTK cho Javascript

Machine Learning

Cài Apache Spark standalone bản pre-built

Data

NLP - Truyện Kiều Word2vec

Machine Learning

Learning R cheatsheet

Machine Learning

Rancher - Quản lý Docker Container bằng UI

Linux

2016

vnTokenizer trên PySpark

Data Engineering

R trên Jupyter Notebook (Ubuntu 14.04 / 14.10 / 16.04)

Data Engineering

Spark: Convert Text (CSV) to Parquet để tối ưu hóa Spark SQL và HDFS

Data Engineering

Chạy Apache Spark với Jupyter Notebook

Data

PySpark - Thiếu thư viện Python trên Worker

Data

2015

Tìm hiểu về hệ thống quảng cáo và quảng cáo Online

News