A major police operation has been launched following reports of a man armed with a sawn-off shotgun in Sydney's Inner West.