| ⇢ | B | GraphBuilder added | |
| ⇢ | A | Loop added | |
| ⇢ | A | DisconnectedGrad added | |
| ⇢ | A | Runtime added | |
| ⇢ | A | MapDict added | |
| ⇢ | A | GlobalEnvironment added | |
| ⇢ | A | TrainingValidator added | |
| ⇢ | A | Attention added | |
| ⇢ | A | VarMap added | |
| A | ↘ | B | NeuralVariable got worse |
| B | ↗ | A | LSTM improved |
| C | ↗ | B | NeuralLayer improved |
| B | ↘ | C | RecurrentLayer got worse |
| A | ↛ | RecursiveAutoEncoder removed | |
| A | ↛ | RecursiveAutoEncoderCore removed | |
| A | ↛ | ErrorRateCost removed | |
| A | ↛ | GPUDataTransmitter removed | |
| A | ↛ | LineIterator removed | |
| A | ↛ | AggregationLayer removed | |
| A | ↛ | AutoEncoderCost removed | |
| A | ↛ | Cost removed | |
| A | ↛ | RegressionCost removed | |
| A | ↛ | CrossEntropyCost removed |