personal-projects/personal-portfolio
Template
1
1
Fork 0
Code Issues 3 Pull Requests Actions Packages Projects 1 Releases Wiki Activity

Sprint 4: Loaders and dbt models #16

New Issue
Closed
opened 2026-01-11 21:02:27 +00:00 by lmiranda · 0 comments
lmiranda commented 2026-01-11 21:02:27 +00:00
Owner
Copy Link

Sprint 4 Deliverables

Loaders

  • portfolio_app/toronto/loaders/__init__.py
  • portfolio_app/toronto/loaders/trreb.py - Load TRREB parsed data to fact_purchases
  • portfolio_app/toronto/loaders/cmhc.py - Load CMHC parsed data to fact_rentals
  • portfolio_app/toronto/loaders/dimensions.py - Load dimension tables

dbt Project Setup

  • dbt/dbt_project.yml - Project configuration
  • dbt/profiles.yml - Database connection (gitignored)
  • dbt/packages.yml - dbt packages

dbt Staging Models

  • dbt/models/staging/stg_trreb__purchases.sql
  • dbt/models/staging/stg_cmhc__rentals.sql
  • dbt/models/staging/stg_dimensions__time.sql
  • dbt/models/staging/stg_dimensions__districts.sql
  • dbt/models/staging/stg_dimensions__zones.sql

dbt Intermediate/Marts

  • dbt/models/intermediate/int_purchases__monthly.sql
  • dbt/models/intermediate/int_rentals__annual.sql
  • dbt/models/marts/mart_toronto_housing.sql

Acceptance Criteria

  • Loaders successfully insert data into PostgreSQL
  • dbt models compile without errors
  • dbt tests pass
  • Data flows: Raw → Parsed → Loaded → dbt → Marts
## Sprint 4 Deliverables ### Loaders - [x] `portfolio_app/toronto/loaders/__init__.py` - [x] `portfolio_app/toronto/loaders/trreb.py` - Load TRREB parsed data to fact_purchases - [x] `portfolio_app/toronto/loaders/cmhc.py` - Load CMHC parsed data to fact_rentals - [x] `portfolio_app/toronto/loaders/dimensions.py` - Load dimension tables ### dbt Project Setup - [x] `dbt/dbt_project.yml` - Project configuration - [x] `dbt/profiles.yml` - Database connection (gitignored) - [x] `dbt/packages.yml` - dbt packages ### dbt Staging Models - [x] `dbt/models/staging/stg_trreb__purchases.sql` - [x] `dbt/models/staging/stg_cmhc__rentals.sql` - [x] `dbt/models/staging/stg_dimensions__time.sql` - [x] `dbt/models/staging/stg_dimensions__districts.sql` - [x] `dbt/models/staging/stg_dimensions__zones.sql` ### dbt Intermediate/Marts - [x] `dbt/models/intermediate/int_purchases__monthly.sql` - [x] `dbt/models/intermediate/int_rentals__annual.sql` - [x] `dbt/models/marts/mart_toronto_housing.sql` ### Acceptance Criteria - Loaders successfully insert data into PostgreSQL - dbt models compile without errors - dbt tests pass - Data flows: Raw → Parsed → Loaded → dbt → Marts
lmiranda added this to the Launch: Host, Bio and Toronto House Market Analysis project 2026-01-12 15:00:47 +00:00
lmiranda self-assigned this 2026-01-12 15:00:54 +00:00
lmiranda moved this to Done in Launch: Host, Bio and Toronto House Market Analysis on 2026-01-14 19:34:04 +00:00
lmiranda removed their assignment 2026-01-14 19:34:46 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Complexity/Complex
High uncertainty or many dependencies
 Complexity/Medium
Some unknowns or dependencies
 Complexity/Simple
Straightforward, well-understood
 Effort/L
3-5 days
 Effort/M
1-2 days
 Effort/S
2-4 hours
 Effort/XL
> 1 week
 Effort/XS
< 2 hours
 Priority/Critical
Immediate attention required
 Priority/High
Important, needs attention soon
 Priority/Low
Nice to have, can wait
 Priority/Medium
Normal priority
 Type/Bug
Something isn't working
 Type/Chore
Maintenance tasks
 Type/Documentation
Documentation improvements
 Type/Feature
New feature or request
 Type/Refactor
Code refactoring without changing behavior
 Type/Test
Testing related
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project Launch: Host, Bio and Toronto House Market Analysis
Assignees
Clear assignees
lmiranda
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: personal-projects/personal-portfolio#16
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?