Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change clip-roberta/bridgetower not to use fast_ddp #1749

Merged
merged 4 commits into from
Feb 7, 2025
Merged

Conversation

jiminha
Copy link
Collaborator

@jiminha jiminha commented Feb 6, 2025

Align the CI test script to follow our latest QA test scripts/Readme

Change clip-roberta to torch-compile
Change bridgetower not to use fast_ddp

@jiminha jiminha requested a review from regisss as a code owner February 6, 2025 00:15
Copy link

github-actions bot commented Feb 6, 2025

The code quality check failed, please run make style.

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

"--distribution_strategy fast_ddp",
"--save_strategy no",
"--use_hpu_graphs",
"--dataloader_num_workers 2",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you update this to 16?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

kibana/Readme all use num_worker to 2, and 16 doesn't make any difference on throughput. Let's keep it with 2.

@libinta libinta added the run-test Run CI for PRs from external contributors label Feb 6, 2025
Copy link
Collaborator

@regisss regisss left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@jiminha Should we consider deprecating fast_ddp moving forward?

@regisss regisss merged commit 6e97ad7 into main Feb 7, 2025
7 checks passed
@regisss regisss deleted the jha/cliproberttest branch February 7, 2025 10:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
run-test Run CI for PRs from external contributors
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants