South Australian oyster growers are reporting recovery after last year's harmful algal bloom is moving at different speeds along the coastline with challenges including a decrease stock and increase in barnacles.