Skip to content

Commit a4e7e6b

Browse files
authored
Update README.md
1 parent 5df8a82 commit a4e7e6b

File tree

1 file changed

+0
-52
lines changed

1 file changed

+0
-52
lines changed

README.md

-52
Original file line numberDiff line numberDiff line change
@@ -128,58 +128,6 @@ The whole content was written in Ipython Notebook then converted into MarkDown.
128128
(2) Difficult to distribute the work load in the beginning of training.
129129

130130

131-
- There are a few distinct differences between Tensorflow and Pytorch when it comes to data compuation.
132-
133-
| | TensorFlow | PyTorch |
134-
|---------------|-----------------|----------------|
135-
| Framework | Define-and-run | Define-by-run |
136-
| Graph | Static | Dynamic|
137-
| Debug | Non-native debugger (tfdbg) |pdb(ipdb) Python debugger|
138-
139-
**How "Graph" is defined in each framework?**
140-
141-
#**TensorFlow:**
142-
143-
- Static graph.
144-
145-
- Once define a computational graph and excute the same graph repeatedly.
146-
147-
- Pros:
148-
149-
(1) Optimizes the graph upfront and makes better distributed computation.
150-
151-
(2) Repeated computation does not cause additional computational cost.
152-
153-
154-
- Cons:
155-
156-
(1) Difficult to perform different computation for each data point.
157-
158-
(2) The structure becomes more complicated and harder to debug than dynamic graph.
159-
160-
161-
#**PyTorch:**
162-
163-
- Dynamic graph.
164-
165-
- Does not define a graph in advance. Every forward pass makes a new computational graph.
166-
167-
- Pros:
168-
169-
(1) Debugging is easier than static graph.
170-
171-
(2) Keep the whole structure concise and intuitive.
172-
173-
(3) For each data point and time different computation can be performed.
174-
175-
176-
- Cons:
177-
178-
(1) Repetitive computation can lead to slower computation speed.
179-
180-
(2) Difficult to distribute the work load in the beginning of training.
181-
182-
183131
# **01 Tensor**
184132

185133
Both TensorFlow and PyTorch are based on the concept "Tensor".

0 commit comments

Comments
 (0)