It's a know issue, but I haven't found a solution yet. It doesn't always happen and is caused by the "group notification" (which needs to be sent for notification grouping to work) not getting dismissed despite sending a dismiss request in the app.
Sorry for the inconvenience!