Top 5 ff for me, at the moment - The Devil of Yuragi-sou; DC: The Kryptonian Emperor; Ascension: The Rise of the Crimson Wizard; Admin of Girls' Chat Group; and In Bleach with a System.
If I'm not wrong, the time stops when he takes a woman from the worlds. At least, it's what i understood.
I think that it's him that beat sephie, so he stops before she faints or something like this.
It's without considering his experiences...
I remember that Smoker arrived in Loguetown two years before Luffy, not three years.