Nothing about inference is free. The card, the power and the depreciation get paid by someone, and for a while that someone was venture money buying market share. Run a consumer graphics card yourself and the bill arrives as hardware instead of a subscription. The free version of this ends the day the subsidies do.