Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unittest recover #41431

Merged
merged 43 commits into from
Apr 9, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
2b967c7
update name
esythan Mar 30, 2022
61e6d9e
update name
esythan Mar 30, 2022
f78fbb5
fix test
esythan Mar 31, 2022
c6c7ec0
fix fleet bind
esythan Mar 31, 2022
fe93dca
update name
esythan Mar 31, 2022
9a943b6
update name
esythan Mar 31, 2022
257d224
resolve conflict
esythan Mar 31, 2022
e57e74d
Merge branch 'name' of https://github.com/esythan/Paddle into async_r…
zhaocaibei123 Mar 31, 2022
9a7a2cf
fix test
esythan Mar 31, 2022
0f4bf8b
Merge branch 'name' of https://github.com/esythan/Paddle into async_r…
zhaocaibei123 Mar 31, 2022
8fdb7ef
fix gpups wrapper
esythan Mar 31, 2022
16b94a5
remove Push/Pull/Load/Save with context in client and wrapper base class
zhaocaibei123 Mar 31, 2022
648cf62
Merge branch 'name' of https://github.com/esythan/Paddle into async_r…
zhaocaibei123 Mar 31, 2022
80f95df
fix conflict
zhaocaibei123 Mar 31, 2022
03b6c3b
Merge branch 'develop' into async_refine
zhaocaibei123 Apr 1, 2022
65c505f
fix
zhaocaibei123 Apr 1, 2022
d4ea5d1
fix
zhaocaibei123 Apr 1, 2022
1e763e4
remove some interface
zhaocaibei123 Apr 2, 2022
40c1539
fix
zhaocaibei123 Apr 2, 2022
e949912
remove
zhaocaibei123 Apr 2, 2022
e14295f
fix conflict
zhaocaibei123 Apr 2, 2022
1d808d3
code style
zhaocaibei123 Apr 2, 2022
56c9033
recover
zhaocaibei123 Apr 2, 2022
878fbc2
fix
zhaocaibei123 Apr 2, 2022
02bdabc
remove code unused
zhaocaibei123 Apr 3, 2022
701fc28
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…
zhaocaibei123 Apr 3, 2022
65ac027
remove some unused table & accessor & CommonDenseTable => MemoryDense…
zhaocaibei123 Apr 3, 2022
49c6f30
fix
zhaocaibei123 Apr 3, 2022
9395987
fix
zhaocaibei123 Apr 4, 2022
cb6267a
fix
zhaocaibei123 Apr 4, 2022
865d2f9
fix conflict
zhaocaibei123 Apr 4, 2022
66cfaab
recover
zhaocaibei123 Apr 4, 2022
755d590
remove unused code
zhaocaibei123 Apr 4, 2022
59da498
recover unittest
zhaocaibei123 Apr 6, 2022
96973e0
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…
zhaocaibei123 Apr 6, 2022
9048cd4
fix
zhaocaibei123 Apr 6, 2022
7fdf72d
remove
zhaocaibei123 Apr 6, 2022
66feaaa
fix
zhaocaibei123 Apr 6, 2022
5bda193
remove code unuseful
zhaocaibei123 Apr 7, 2022
8f0fd47
remove
zhaocaibei123 Apr 7, 2022
c6721fb
fix
zhaocaibei123 Apr 7, 2022
b1afda8
recover
zhaocaibei123 Apr 8, 2022
614431f
remove
zhaocaibei123 Apr 9, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
310 changes: 0 additions & 310 deletions paddle/fluid/distributed/common/sparse_sharding_merge.h

This file was deleted.

38 changes: 37 additions & 1 deletion paddle/fluid/distributed/ps/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,39 @@
# 目录说明

> 成型之后,上级目录的 table、thirdparty、table、service 目录可以删除,communicator_common.h 、fleet.cc、fleet.h 删除
Table: for param storage and update
-----MemorySparseTable: table for sparse param, used in cpu async mode
-----MemoryDenseTable: table for dense param, used in cpu async/geo mode
-----MemorySparseGeoTable: table for sparse param, used in cpu async mode
-----CommonGraphTable: table used for graph learning
-----BarrierTable: table for barrier function, used in cpu sync mode
-----TensorTable: table which run program, used for learning rate decay only

ValueAccessor: for pull param and push gradient
-----CtrCommonAccessor: pull/push value with show/click, float type
-----DownpourCtrDoubleAccessor: same as CtrCommonAccessor, other than show/click with double type
-----SparseAccessor: used for common embedding, pull value without show/click, push value with show/click
-----CommMergeAccessor: used for dense table only, for get param dim

PsService(proto): for server to handle request
-----PsBaseService
----------BrpcPsService: for cpu dnn training task
----------GraphBrpcService: for graph learning
-----HeterService: for dnn training task with heterogeneous computing resources

PSServer: recv request from trainer and handle it by service
-----BrpcPsServer: for cpu dnn training task
-----GraphBrpcServer: for graph learning
-----PsLocalServer: for GpuPS

HeterServer: for HeterPS

PSClient: pull param and push gradient for trainer
-----BrpcPsClient: for cpu dnn training task
----------GraphBrpcClient: for graph learning
-----PsLocalClient: for GpuPS

HeterClient: for HeterPS

PSCore: Wrapper for InitServer

GraphPyService: for graph learning
Loading