Because the speakerphone was on, everyone else also heard Robinson William's words. Although they had some private criticisms, they did not voice them outwardly.
In fact, even if this incident had not occurred, if Ye Liuyun had chosen to not rescue the drowning person or even strongly prevented them from doing so, they might have also given up on saving Fabian who fell into the water.
Although they had a relatively good relationship with Fabian, it was not to the extent that they were willing to put themselves in danger for his sake.
After Fabian was thrown into the water, he quickly came to his senses. He wasn't a landlubber and, given his respectable Cultivation Level, he did not need to worry about safety in the water for a short period.