An influencer who built a garden gym in a residential area in Norfolk despite planning permission has left neighbours fuming.