Well, there should something like loans? It is just that both parties have duties. If the one giving a loan does not have reasonably expectation that the loan will be paid back, he should not have the right to loan in the first place. (or expect the money back in form of selling all the other party's stuff.) On the other hand, the loaner also should have duty to pay the money back.
I would call insurance a form of usury too. Perhaps loans and insurance should be tasks of govt, but as everything, how do you keep govt doing its purposes well. One could ask the same thing of free market, with the predictable answer, but that would lead back to the problem of usury. And does free market really guarantee quality?

Another form of usury i find especially bad, is the stock market. As far as i can see it was originally intended as a way to invest in companies, which i think is fine.(In a capitalist framework, at least) But now the stocks seem to have taken on a life of its own. Value of stocks depends too much on how bad others (dont) want them.
One way i see investing in new ideas might work is: Investigate idea, if good idea, give money, pray that the idea was actually a good one, and then get money back+ risk money. Of course, the enterprise might go no-where so that it is stopped earlier, then some money goes back earlier to save it. Or the enterprise goes better then expected and more investment is needed, then that is an idea, and new investments are possible.
When many people want to invest in something, 'stock prices' should not go up, the amount of reward risk money should go down. The person willing to leave with the lowest risk money will win an auction of investment.

Yet another case of economic anarchy is people having to choose between working unreasonably hard or starving/losing their homes/not being able to educate their children. I think taxes from the richer should come in to ensure that all people (or at least as many as possible) can get a decent living, and everyone who is smart enough gets access to education at any level at some point in their life, this without student loans as that will undermine the decent living thing i said.

PS IMO