Skip to content

Conversation

@kmontemayor2-sc
Copy link
Collaborator

@kmontemayor2-sc kmontemayor2-sc commented Jan 10, 2026

Scope of work done

Setting up distributed neighborloader for graph store (GS) mode.

In this change we:

  1. Introduce RemoteDistDataset as an input for the loader
  2. Allow the loader to take in list[Tensor] as inputs for GS sampling.
  3. Add tests that the above work together :)

Where is the documentation for this feature?: N/A

Did you add automated tests or write a test plan?

Updated Changelog.md? NO

Ready for code review?: NO

@kmontemayor2-sc
Copy link
Collaborator Author

/unit_test_py

@kmontemayor2-sc
Copy link
Collaborator Author

/integration_test

@kmontemayor2-sc
Copy link
Collaborator Author

/e2e_test

@github-actions
Copy link
Contributor

GiGL Automation

@ 24:08:24UTC : 🔄 Python Unit Test started.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 10, 2026

GiGL Automation

@ 24:08:29UTC : 🔄 Integration Test started.

@ 01:08:15UTC : ✅ Workflow completed successfully.

@github-actions
Copy link
Contributor

GiGL Automation

@ 24:08:31UTC : 🔄 E2E Test started.

Copy link
Collaborator

@mkolodner-sc mkolodner-sc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Kyle! Left a round of comments

@kmontemayor2-sc
Copy link
Collaborator Author

/unit_test_py

@kmontemayor2-sc
Copy link
Collaborator Author

/integration_test

@github-actions
Copy link
Contributor

GiGL Automation

@ 23:41:27UTC : 🔄 Python Unit Test started.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 13, 2026

GiGL Automation

@ 23:41:31UTC : 🔄 Integration Test started.

@ 24:53:37UTC : ✅ Workflow completed successfully.

@kmontemayor2-sc
Copy link
Collaborator Author

/e2e_test

@github-actions
Copy link
Contributor

GiGL Automation

@ 24:06:23UTC : 🔄 E2E Test started.

@kmontemayor2-sc
Copy link
Collaborator Author

/e2e_test

@kmontemayor2-sc
Copy link
Collaborator Author

/unit_test_py

@kmontemayor2-sc
Copy link
Collaborator Author

/integration_test

@github-actions
Copy link
Contributor

github-actions bot commented Jan 14, 2026

GiGL Automation

@ 17:55:50UTC : 🔄 E2E Test started.

@ 19:13:17UTC : ✅ Workflow completed successfully.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 14, 2026

GiGL Automation

@ 17:55:55UTC : 🔄 Python Unit Test started.

@ 18:59:09UTC : ✅ Workflow completed successfully.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 14, 2026

GiGL Automation

@ 17:56:05UTC : 🔄 Integration Test started.

@ 18:59:57UTC : ✅ Workflow completed successfully.

Copy link
Collaborator

@mkolodner-sc mkolodner-sc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Kyle! Generally LGTM to me

@kmontemayor2-sc
Copy link
Collaborator Author

/unit_test_py

@kmontemayor2-sc
Copy link
Collaborator Author

/integration_test

@kmontemayor2-sc
Copy link
Collaborator Author

/e2e_test

@github-actions
Copy link
Contributor

github-actions bot commented Jan 15, 2026

GiGL Automation

@ 21:11:30UTC : 🔄 Python Unit Test started.

@ 22:19:48UTC : ✅ Workflow completed successfully.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 15, 2026

GiGL Automation

@ 21:11:36UTC : 🔄 Integration Test started.

@ 22:11:08UTC : ✅ Workflow completed successfully.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 15, 2026

GiGL Automation

@ 21:11:42UTC : 🔄 E2E Test started.

@ 22:33:42UTC : ✅ Workflow completed successfully.

Copy link
Collaborator

@svij-sc svij-sc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for addressing everything

LGTM beyond this thread:
https://github.com/Snapchat/GiGL/pull/432/changes#r2687675025

@kmontemayor2-sc kmontemayor2-sc added this pull request to the merge queue Jan 17, 2026
@svij-sc
Copy link
Collaborator

svij-sc commented Jan 17, 2026

I will approve to unblock, but lets revisit the dictionary consideration here before calling this complete.

@kmontemayor2-sc
Copy link
Collaborator Author

I will approve to unblock, but lets revisit the dictionary consideration here before calling this complete.

Ack, I expect this to be a part of scale testing.

Merged via the queue into main with commit 9bb5d85 Jan 17, 2026
6 checks passed
@kmontemayor2-sc kmontemayor2-sc deleted the kmonte/support-gs-for-neighbor-loader branch January 17, 2026 01:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants