That is the correct behaviour! The charge IC can’t tell the difference between a full battery and no battery, so it cycles between trying to charge and not charge.
If you are not using a battery on your project, or you don’t need the use of the charge status LED, you can disconnect it by cutting the jumper on the back of the board, as indicated.