Once a connection is stuffed, adding valid inventories does not get this connection unstuffed.
This is demonstrated in this image by the trash can not getting while every other connection is stuffed.
Dynious commented
This is intentional, ItemDucts can cause immense TSP lag when stuffed because they keep checking and bouncing around the ducts. In a normal situation where there are no changes to the relocator 'grid' this will function correctly.