He says this reminds him of the Abu Ghraib abuse photos taken in Iraq years ago.
And the congressman says there's no question this will hurt America.
At least seven protesters have been killed during anti-American demonstrations in Afghanistan.
The Qurans and religious books were reportedly pulled from the shelves of a detention center library at Bagram Air Base because they contained extremist messages or inscriptions.
"Sometimes, as in life in general, some seemingly small - dumb decision - can have lasting consequences. And the big thing, of course, that we're worried about is an increase of danger to our troops -- undermining what they sacrifice to achieve there."
Yesterday, the U.S. apologized for the disposal of the material.
Congressman Thornberry says that was the right thing to do.
The U.S. military is still investigating the incident.
Copyright 2015 Nexstar Broadcasting, Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.