Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

graph-engine cache optimization #37168

Merged
merged 202 commits into from
Nov 15, 2021
Merged

graph-engine cache optimization #37168

merged 202 commits into from
Nov 15, 2021

Conversation

seemingwang
Copy link
Contributor

PR types

Performance optimization

PR changes

Others

Describe

graph-engine cache optimization

seemingwang and others added 30 commits February 25, 2021 12:30
@seemingwang
graph engine demo
9d24726
@seemingwang
upload unsaved changes
7753f38
@seemingwang
fix dependency error
5fa66ab
@seemingwang
fix shard_num problem
3e12386
@seemingwang
py client
acacce0
@seemingwang
remove lock and graph-type
3f32bf1
@Yelrose
Merge pull request #2 from seemingwang/develop
dda5291 
Merge Graph Engine
@Yelrose
add load direct graph
44df9ac
@Yelrose
add load direct graph
c8e67b8
@Yelrose
add load direct graph
7320994
@WeiyueSu
batch random_sample
f4ea973
@WeiyueSu
batch_sample_k
492e551
@WeiyueSu
fix num_nodes size
193203f
@WeiyueSu
batch brpc
b55bf42
@WeiyueSu
batch brpc
102ae95
@WeiyueSu
add test
3106b2a
@WeiyueSu
add test
51ed7d8
@seemingwang
Merge pull request #1 from Yelrose/develop
94025b9 
Add Simple Loading for Direct Graph
@Yelrose
add load_nodes; change add_node function
e087485
@Yelrose
Merge pull request #3 from seemingwang/develop
455e2a0 
Merge pull request #1 from Yelrose/develop
@seemingwang
change sample return type to pair
c588c96
@Yelrose
merge
391b8e5
@Yelrose
resolve conflict
2dc7ebf
@Yelrose
Merge branch 'develop' of https://github.com/Yelrose/Paddle into develop
f1ea3ac
@Yelrose
resolved conflict
e359135
@Yelrose
resolved conflict
a4e8939
@Yelrose
resolved conflict
290840f
@seemingwang
separate server and client
d98be69
@WeiyueSu
merge pair type
db6ee86
@Yelrose
resolved conflict
550a23f
@seemingwang
fix distributed op combining problems
ff9fec7
@seemingwang
Merge remote-tracking branch 'upstream/develop' into develop
17fb675
@seemingwang
optimize
1ff10c6
@seemingwang
remove logs
5131c0c
@seemingwang
Merge remote-tracking branch 'upstream/develop' into develop
4e34361
@seemingwang
Merge remote-tracking branch 'upstream/develop' into develop
db2452e
@seemingwang
fix MultiSlotDataGenerator error
d5f4e65
@seemingwang
cache for graph engine
7921b74
@seemingwang
fix type compare error
ef02848
@seemingwang
more test&fix thread terminating problem
8692ff5
@seemingwang
remove header
d248672
@seemingwang
change time interval of shrink
ccfd3e8
@seemingwang
Merge remote-tracking branch 'upstream/develop' into develop
940a85b
@seemingwang
use cache when sample nodes
adb29a4
@seemingwang
remove unused function
a11ef3f
@seemingwang
change unique_ptr to shared_ptr
e90c780
@seemingwang
simplify cache template
058e944
@seemingwang
fix conflict
e51abd0
@seemingwang
cache api on client
c8d91fb
@seemingwang
fix
0c0b63e
@seemingwang
reduce sample threads when cache is not used
24e1df2
@seemingwang
reduce cache memory
9bc1f35
@seemingwang
resolve conflict
1325315
@seemingwang
cache optimization
2e48442
@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@seemingwang seemingwang merged commit b44db69 into PaddlePaddle:develop Nov 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Thunderbrook Thunderbrook Thunderbrook approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@seemingwang @Thunderbrook @Yelrose @WeiyueSu @Liwb5 @seiriosPlus