ELT ãšã¯ïŒ
- åŸæ¥ã®ETLïŒExtract-Transform-LoadïŒãšã¯é åºãéã§ãçããŒã¿ããŸãããŒã¿ãŠã§ã¢ããŠã¹ã«ããŒãããŠãã倿åŠçãè¡ã
- BigQueryãSnowflakeãªã©ã¯ã©ãŠãDWHã®èšç®åãæŽ»ããã倧éã®çããŒã¿ããã®ãŸãŸåã蟌ãã§ããSQLã§å€æã§ãã
- dbtïŒdata build toolïŒãELTã®Transformå·¥çšã§åºã䜿ãããŠãããSQLããŒã¹ã§ããŒã¿ã¢ããªã³ã°ããã¹ããè¡ãã
- çããŒã¿ããã®ãŸãŸæ®ããããããšããæ°ããèŠç¹ã§å倿ã»ååæã§ããæè»æ§ãETLããé«ã
ETLã¯èããããšãããã©ãELTã£ãŠäœãéãã®ïŒ
ETLã¯ãæœåºâ倿âèªã¿èŸŒã¿ãã®é çªã§ãããŒã¿ãæŽåœ¢ããŠããDBã«å ¥ãããã ãELTã¯ãæœåºâèªã¿èŸŒã¿â倿ãã§ãçããŒã¿ããŸãDWHïŒããŒã¿ãŠã§ã¢ããŠã¹ïŒã«ããŒã³ãšå ¥ããŠã倿ã¯åŸããããã
é çªãå€ããã ãã§ãããªã«éãã®ïŒ
倧éãã ãïŒETLã ãšå€æçšã®äžéãµãŒããŒãå¿ èŠã§ãããŒã¿éãå¢ãããšããã«ããã¯ã«ãªããã ãELTãªãBigQueryãSnowflakeã¿ãããªã¯ã©ãŠãDWHã®ãã¯ãŒã§å€æããããããã¿ãã€ãçŽã®ããŒã¿ã§ãã¹ã±ãŒã«ããã
çããŒã¿ããã®ãŸãŸå ¥ããŠå€§äžå€«ãªã®ïŒ
ããããããã¡ãªãããªãã ãçããŒã¿ãæ®ã£ãŠãããããã£ã±ãå¥ã®åãå£ã§åæããããã£ãŠãªã£ããšããå ããŒã¿ããå倿ã§ãããETLã ãšå€ææžã¿ããŒã¿ãããªããããããçŽãã倧å€ãªãã ã
dbtã£ãŠããèããã©ãELTãšé¢ä¿ããã®ïŒ
dbtïŒdata build toolïŒã¯ãŸãã«ELTã®ãTããæ åœããããŒã«ã ããSQLã§ããŒã¿ã®å€æããžãã¯ãæžããŠããã¹ããããã¥ã¡ã³ãçæãŸã§èªååã§ãããããŒã¿ãšã³ãžãã¢ã®éã§ã¯ä»ãããã¡ã¯ãã¹ã¿ã³ããŒãã«ãªã£ãŠããã
ãããããETLã¯äœ¿ããªãã®ïŒ
ããããããŸã çŸåœ¹ã ããæ©å¯ããŒã¿ã倿ããŠããããŒããããå Žåããã¬ã¬ã·ãŒã·ã¹ãã ãšã®é£æºã§ã¯ETLãé©ããŠãããšããããã§ãã¯ã©ãŠããã€ãã£ããªæ°èŠãããžã§ã¯ãã§ã¯ELTãäž»æµã«ãªãã€ã€ããããFivetran ã§ E ãš L ããã£ãŠãdbt ã§ T ãããããšãããã¿ãŒã³ãã¢ãã³ããŒã¿ã¹ã¿ãã¯ã®å®çªã ã