Commit graph

51 commits

Author SHA1 Message Date
Elshimy Ziad Magdy Taha
fcbe2f04f9 Collapse shared Go packages into the root module
internal/ and libs/ were split into 9 single-package Go modules, held
together by 22 replace directives across 7 go.mod files. The module
boundaries bought nothing: internal/dto, internal/browser and
internal/migrations were already plain packages in the root module and
worked fine.

Delete the 9 go.mod/go.sum pairs so those packages belong to the root
github.com/jobs-scraper module. Import paths are unchanged --
github.com/jobs-scraper/internal/domain resolves identically whether it
is its own module or a package inside the root module -- so no .go file
is touched by this commit.

Each deployable module now needs one require + one replace on the root
module instead of four to six:

  go.work entries:      14 -> 5
  replace directives:   22 -> 4
  go.mod files:         14 -> 5

Dependency versions are deliberately held at their previous pins. A bare
go mod tidy resolved several to latest once the per-package constraints
were gone (lib/pq 1.10.9 -> 1.12.3, amqp091-go 1.10.0 -> 1.13.0,
migrate 4.19.0 -> 4.19.1, go-openai 1.41.2 -> 1.42.0, genai
1.39.0 -> 1.66.0); all five are pinned back, since a structural refactor
should not move dependency versions.

Side effect worth noting: `go build ./...` at the repo root previously
matched only 2 packages, because everything else sat behind a module
boundary. It now covers all 12 shared packages, so the build and vet
steps in .forgejo/workflows/ actually exercise the shared code.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-04 17:27:10 +05:00
Elshimy Ziad Magdy Taha
44c8255358 Remove dead internal/infrastructure/http package
internal/infrastructure/http was unreferenced: the live HTTP layer is
services/api/pkg/http, wired in services/api/cmd/server/main.go.

The deleted copy was a strict subset of the live one, not a divergence:
it lacked the GetJobs and ApplyForJob handlers and their route
registrations, and its CORS middleware hardcoded
Access-Control-Allow-Origin: * where the live version reflects the
request Origin.

Removing it also drops the only internal/ -> libs/ import edge, so
dependencies between the two shared roots now point one way
(libs/{ports,repo} -> internal/{domain,dto}). go mod tidy consequently
dropped libs/ports, libs/repo, internal/utils and gorilla/mux from
internal/infrastructure, whose orphaned replace directives are removed
here too.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-04 17:21:18 +05:00
Elshimy Ziad Magdy Taha
29a3d5bdbb fix docker command not found
All checks were successful
Deploy scraper-google / build (push) Successful in 16m15s
Deploy scraper-google / deploy (push) Successful in 20m7s
2026-07-10 11:54:48 +05:00
Elshimy Ziad Magdy Taha
5d10319df7 fix deploy
Some checks failed
Deploy scraper-google / build (push) Successful in 15m28s
Deploy scraper-google / deploy (push) Failing after 19s
2026-07-09 18:58:28 +05:00
Elshimy Ziad Magdy Taha
26301bd805 fix deploy script
All checks were successful
Deploy scraper-google / build (push) Successful in 17m58s
Deploy scraper-google / deploy (push) Has been skipped
2026-07-09 18:37:55 +05:00
Elshimy Ziad Magdy Taha
3760af175a fix pipeline 2
All checks were successful
Deploy scraper-google / build (push) Successful in 17m37s
Deploy scraper-google / deploy (push) Has been skipped
2026-07-09 18:06:06 +05:00
Elshimy Ziad Magdy Taha
96532caddf pipeline
Some checks failed
Deploy scraper-google / build (push) Failing after 4m46s
Deploy scraper-google / deploy (push) Has been skipped
2026-07-09 17:43:19 +05:00
26ce8713e5 Delete .github/workflows/ci.yml 2026-07-09 12:19:21 +00:00
Elshimy Ziad Magdy Taha
af52085ea3 fix errors and restructure project 2026-01-26 17:33:48 +05:00
Elshimy Ziad Magdy Taha
a281363b61 hiring cafe scraper 2025-12-29 12:19:33 +05:00
Elshimy Ziad Magdy Taha
8a4ad07e46 fix swagger 2025-12-18 14:02:13 +05:00
Elshimy Ziad Magdy Taha
13d10e9d11 get jobs method with filters 2025-12-18 12:25:07 +05:00
Elshimy Ziad Magdy Taha
cbcf9bdcc7 refactor 2025-12-17 17:42:42 +05:00
Заид Омар Медхат | Zaid Omar Medhat
18842091a4 fix: add migrations to docker 2025-12-16 18:31:54 +05:00
Заид Омар Медхат | Zaid Omar Medhat
9ef1833073 f 2025-12-16 18:21:40 +05:00
Elshimy Ziad Magdy Taha
bb55154a19 fix ip host rabbitmq 2025-12-16 18:10:05 +05:00
Elshimy Ziad Magdy Taha
2a137d3b61 remove version 2025-12-16 18:07:50 +05:00
Elshimy Ziad Magdy Taha
3187757776 docker for api 2025-12-16 18:05:47 +05:00
Elshimy Ziad Magdy Taha
a8c253bdd5 used lever instead of greenhouse temporarily 2025-12-16 17:19:44 +05:00
Elshimy Ziad Magdy Taha
d57c1a4ce3 debug 2 2025-12-15 14:40:24 +05:00
Elshimy Ziad Magdy Taha
92cec1bf65 fixes 2025-12-15 14:36:37 +05:00
Elshimy Ziad Magdy Taha
ddd5f890f5 debug log 2025-12-15 14:19:40 +05:00
Elshimy Ziad Magdy Taha
46a4d54df9 only first page 2025-12-15 14:02:05 +05:00
Elshimy Ziad Magdy Taha
2a1ce7123e 24 hours delay 2025-12-15 13:48:58 +05:00
Elshimy Ziad Magdy Taha
6154e95d32 fix schedule 2025-12-15 13:02:28 +05:00
Elshimy Ziad Magdy Taha
4bbf4243c7 fixed docker-compose 2 2025-12-15 12:41:42 +05:00
Elshimy Ziad Magdy Taha
6f30edbce2 fix docker-compose 2025-12-15 12:34:47 +05:00
Elshimy Ziad Magdy Taha
721888383f fix go version 2025-12-15 12:29:11 +05:00
Elshimy Ziad Magdy Taha
a04ee0343c fix docker file 2025-12-15 12:27:36 +05:00
Elshimy Ziad Magdy Taha
ab9346e96b fix headless 2025-12-15 12:24:13 +05:00
Zeyad Elshimy
9f7fa431f7 Merge branch 'master' into 'main'
feat: add job analysis infrastructure and Glassdoor support

See merge request alricade/jobs-scraper!1
2025-12-15 07:19:35 +00:00
Zeyad Elshimy
c72ab49bc1 Delete README.md 2025-12-15 07:19:07 +00:00
Elshimy Ziad Magdy Taha
2589c81797 deploy 2025-12-15 12:17:08 +05:00
Elshimy Ziad Magdy Taha
1dd59249c5 schedule 2025-12-15 10:31:25 +05:00
Zeyad Elshimy
3200b3500c Initial commit 2025-12-15 05:27:20 +00:00
Elshimy Ziad Magdy Taha
a195d3b8fe google scraper 2025-12-15 10:26:52 +05:00
Elshimy Ziad Magdy Taha
5060643a3f infrastructure fixes 2025-11-03 00:29:33 +05:00
Elshimy Ziad Magdy Taha
06f5f9cf02 add env 2025-11-01 17:52:12 +05:00
Elshimy Ziad Magdy Taha
8ac872bdc6 feat: restructure project into monorepo with CI/CD
- Reorganized project structure into services/ and apps/ directories for better separation of concerns
- Added comprehensive CI/CD pipeline with GitHub Actions for testing and Docker builds
- Created .dockerignore file to optimize container builds
- Updated Makefile with new targets for each service and application
- Added detailed README with architecture overview, setup instructions and development guidelines
- Moved cron-analyzer to dedicate
2025-11-01 16:20:44 +05:00
Elshimy Ziad Magdy Taha
e54e5fb9ea added monorepo architecture 2025-11-01 10:59:58 +05:00
Elshimy Ziad Magdy Taha
0e1b64b7b9 refactor and remove internal file 2025-10-24 15:24:58 +05:00
Elshimy Ziad Magdy Taha
0ab6954231 feat: add job analysis infrastructure and Glassdoor support
- Added new job analysis result repository and database migration system
- Expanded job creation to support Glassdoor as a new provider alongside LinkedIn
- Added CV analysis service launch configuration in VS Code
- Updated Makefile with new commands for scraper service and migrations
- Improved environment loading in cron analyzer to support local development
- Added error handling for unsupported job providers
- Integrated job analysis results
2025-10-24 15:10:20 +05:00
Elshimy Ziad Magdy Taha
7c78f11dcf feat: add job status tracking and analysis queue infrastructure 2025-10-12 22:56:20 +05:00
Elshimy Ziad Magdy Taha
3887b97b11 readme 2025-10-11 13:56:45 +05:00
Elshimy Ziad Magdy Taha
23372eb2c4 rabbitmq 2025-10-11 13:55:38 +05:00
Elshimy Ziad Magdy Taha
24b5bf1d08 microservices 2025-10-04 17:18:49 +05:00
Elshimy Ziad Magdy Taha
7bf35ccb6b refactor 2025-09-29 22:44:30 +05:00
Elshimy Ziad Magdy Taha
c470edd187 retryable http 2025-09-28 21:31:11 +05:00
Elshimy Ziad Magdy Taha
a0e1728276 remove readme 2025-09-28 21:05:46 +05:00
Elshimy Ziad Magdy Taha
d637f5f112 fix env file config 2025-09-28 21:03:50 +05:00