'Tensorflow Object Detection: use Adam instead of RMSProp
I'm training a CNN with this [.config file][1]:
rms_prop_optimizer: { learning_rate: { exponential_decay_learning_rate { initial_learning_rate: 0.004 decay_steps: 800720 decay_factor: 0.95 } } momentum_optimizer_value: 0.9 decay: 0.9 epsilon: 1.0 }}
As you can see there is a rms_prop as optimizer. What if I would like to use Adam? How am I supposed to edit this file?
Solution 1:[1]
Sorry if I am late but I am researching this field nowadays.
I realized we can check inside this directory for some examples of ADAM optimizers:
Tensorflow/models/research/object_detection/builders/optimizer_builder_tf2_test.py
Here is the optimizer config into my pipeline.config without scheduling:
optimizer {
adam_optimizer: {
learning_rate: {
constant_learning_rate {
learning_rate: 0.0001
}
}
}
use_moving_average: false
}
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | Dennis |
