Editing cloth mesh is not going to help and would make things worse as you have learned.
Such type of cloth should really be fitted and weighted in T-pose to begin with.
Where did you import a hoodie from?
You can simulate it over in Blender (if you do not have Marvelous Designer) from A to a T-pose, import back to CC and transfer weight in T-pose.
Or you may convert it to accessory in T-pose (baking a shape), use sculpt brush to distribute the mesh properly under arms and then Transfer Skin Weight.
Note: It is not possible to simulate 100% correct behavior of baggy cloth items with just bones weight influence.
Here, I did mess up this hoodie and then fixed it with second method I mentioned. Your case seems worse and you'd probably have to spend more time.