Hi Mike
I took a quick look at your site - nice job! Good design, plenty of interesting content, and I like your conversational writing style. Your personality definitely comes through.
But given that it doesn't appear geared toward attracting traveling consumers, your most likely target audience would be people who simply want to follow your adventures because of your personality, rather than to research information for a trip to place that you write about (please feel free to correct my misimpression if you think I'm off-base).
So with that impression in mind, I think the best thing for you to do, aside from ensuring that you post new content on a consistent and somewhat frequent basis, is to get out there in the community of travel bloggers and engage with them in a meaningful way - that means leaving thoughtful comments on their posts, participating in various groups, communities, and forums (such as the Travel Bloggers Group on Facebook) and follow other travel bloggers on Twitter.....
The reason that I suggest connecting with other travel bloggers is that many of them are like-minded, in that they love to simply connect with, and read about, other travelers, and on the whole they are a very engaging and supportive group.
Another thing you can do to attract more traffic is, of course, to spend time on your SEO - determining what keywords or phrases you want to draw traffic for, and focus on what you can do to improve your search engine results for those words and phrases, but don't sacrifice your writing style to it - after all, your stories are what people will enjoy. There are a lot of websites and guides on SEO but I do think that Andy Hayes' book "Mastery Guides: DIY SEO" is a simple, straightforward, and easy to follow instruction book.
Good luck and post back sometime to let me know how it's going