Sufism is much maligned as much in western writers as it is in some eastern writers.
The correct title is Tasawwuf and this is about making an internal journey to God by becoming serious in applying the Prophetic practise.
Many opponents to this are those who are Wahabis who claim things without understanding them.
There are some people who claim that there are sufis and are clearly astray yet there are others who you can tell are rightly guided.
So the correct tasawwuf has nothing to do with external practises and is firmly rooted in the Prophetic practise.