Which kite did you use, and how good is your body drag technique?
Might sound like a lousy question, I know, but I think many "think" they can bodydrag well, but they can not...
As said very often, many try to bodydrag upwind, which wont work - you gotta superman sidewind, to go upwind.
NEVER point your body/arm upwind, and you wont get anywhere really, only because most boards go downwind, you get the illusion you can go upwind yourself.
A good exercize would be to go out when onshore, and bodydrag close to the coast, around a buoy.
Then you can practice going fast upwind very easily, because of your fixed point and no current.
Current does not matter though, only when using an anchored point like a buoy.
Most will be amazed at how high and fast they can bodydrag upwind, once they get it right "not" pointing upwind