Majority of the time they pick a plant and work their way around the flower collecting the nectar…then off to another flower to repeat the process. This will continue for short periods of time then they disappear as fast as they appeared.
I would only think that they are perhaps taking a break before getting back to the flowers.