Whether it’s numbers, a religious entity, or laws of physics, most people intuitively accept some form of abstract object that exists outside of the physical or material world. They also solve many philosophical problems that seem fatal to a view without abstract objects, making it common for most philosophers to believe in and reason from their existence. But accepting abstract objects also creates serious philosophical and practical problems that cannot be ignored. I seek to demonstrate these problems as well as presenting a constructive case for a view without abstract objects that avoids common criticisms by incorporating findings in physics. Through this, I hope to show the efficacy of philosophizing from a position of agnosticism as to abstract objects, focusing on problems that are important whether or not abstract objects ultimately exist.