The House That Saved Old Town: Inside Audubon House and Tropical Gardens

A Wrecker’s Mansion at Whitehead and Greene

In October 1846, a hurricane tore through Key West and damaged or destroyed nearly every home on the island. In the aftermath, Capt. John Huling Geiger — a harbor pilot and master wrecker, and one of the wealthiest men in town — started building. Construction ran from 1846 to 1849.

Geiger chose his corner deliberately. Whitehead and Greene put the house in full view of everyone coming and going from the waterfront, which was exactly the point. He hired the island’s best carpenters and spent on the best materials: a frame and floors of Dade County pine, cypress exterior doors, a mahogany staircase, the whole structure joined with mortise and tenon. The style was American Classic Revival, and a cupola at the roofline — long since gone — gave him an unobstructed view of the sea. For a wrecker whose living depended on being first to a ship in trouble, that view was not decoration. It was the business.

The Recluse, the Gas Station, and the Rescue

Four generations of Geigers lived in the house for close to 110 years. The last was the captain’s great-grandson, Capt. William Bradford Smith, a recluse who spent more than two decades there alone with no electricity, no running water, and no indoor kitchen. By his death in 1956, the windows were shuttered and nailed shut and the house was falling in on itself.

In 1958 it was slated for demolition to make room for a gas station. A local resident named Jessie Porter got word to Mitchell and Frances Wolfson, a family with Key West roots going back to the 1870s and a goods store on Duval. The Wolfsons bought it. Two years of restoration followed — electricity included — and the Audubon House Museum opened in 1960.

That single rescue is the hinge point. It was the first large-scale restoration on the island, and it proved that these houses were worth saving. The Historic Old Town district that draws people to Key West today grew directly out of that decision. The Mitchell Wolfson Family Foundation still cares for the property.

The Audubon Connection, Straightened Out

The name confuses people, and reasonably so. John James Audubon visited Key West in 1832 — fourteen years before this house existed. So how does his name end up on the door?

The answer is the land, not the building. Audubon arrived with a letter of introduction to Dr. Benjamin Strobel, whose house stood on this same property, then owned by island founder Pardon Greene. Several families lived on the lot, the Geigers among them, and at its center was a garden of native and imported tropical plants. Audubon used those plants as the settings for his images of local birds. Twenty-two of the 435 original Havell plates in "The Birds of America" show birds he observed and painted in Florida in 1831 and 1832.

Local folklore about that connection is part of what persuaded the Wolfsons to save the house in the first place. The museum they opened commemorates the 1832 visit and shows Audubon’s work inside the Geiger family’s rooms.

What You Will See Today

The house is furnished with antiques from the first half of the 19th century, including pieces that belonged to the Geigers — look for the portrait of Capt. Geiger in the parlor and the family serving table in the dining room. Guides give an introduction and then let you move through the house and grounds at your own pace, which is the right way to see it.

Outside is close to an acre of tropical garden in the middle of Old Town, plus a replica cook house that shows how meals were actually made in mid-19th-century Key West, in a separate structure that kept the heat out of the main house. Set aside more time in the garden than you think you need. It is one of the quietest places on the island and the sound of Duval simply stops at the fence line.

Featured Stays: Two Restorations of Your Own 

The preservation story that started at 205 Whitehead is the same story behind the homes we manage. Two of them sit within an easy walk of the museum, and both are available to book now:

Potter’s Cottage  (2BR/2BA, sleeps 4)  — a two-story cottage on historic Whitehead Street, originally an artisan potter’s shop from 1918 and lovingly updated since. Rocking chairs on the covered front porch, an open-concept living room and kitchen, and large French doors that open onto a partly covered deck with a private cocktail pool, outdoor shower, and gas grill. The primary king bedroom and ensuite bath occupy the open loft upstairs; a queen bedroom and full bath sit on the first floor, and a small bonus room with a built-in bookcase makes a fine reading corner. The pool is heated seasonally, November through April, for an additional fee. Parking is on-street; the location is a block off Duval, which means you will not need a car anyway.

Ideal for: Two couples or a small family who want a private pool and a front porch on the same street as the museum.

Chavez House  (3BR/2BA, sleeps 6)  — a quintessential Key West eyebrow house built in 1870 on Margaret Street and beautifully restored, with Dade County pine wall accents that echo the craftsmanship at Audubon House. The first floor holds the family room, dining room seating six, an updated kitchen with quartz counters and a vaulted shiplap-style ceiling, and a primary king bedroom. French doors open to a fenced yard with a private pool, lush landscaping, and a covered lanai with a pass-through window from the kitchen. Two queen bedrooms with vaulted ceilings sit upstairs. The pool is heated seasonally, November through April, for an additional fee, and one dog up to 25 pounds is welcome with an additional fee and completed pet addendum.

Ideal for: Families or three couples who want an authentic historic home with room to spread out and a private pool to come home to.

Both homes are managed by Historic Key West Vacation Rentals. Book direct and save — our team knows these houses, and this island, better than any listing site does.

Planning Your Visit

• Location: 205 Whitehead St., at the corner of Greene Street, a short walk from Mallory Square and the Historic Seaport.
• Hours: the house is open daily, 9:30 a.m. to 4:15 p.m.; the gallery and gift shop stay open until 5 p.m. Confirm current hours at audubonhouse.org before you go.
• Timing: allow 60 to 90 minutes to see the house and the gardens without rushing.
• Pair it with: the Custom House across the street, the Historic Seaport a few blocks north, and sunset at Mallory Square to close out the afternoon.
• Best moment: mid-morning on a weekday, when the garden is shaded and nearly empty.

Frequently Asked Questions

Did John James Audubon live in the Audubon House?

No. Audubon visited Key West in 1832 and spent time on this property, which then held several homes and a large tropical garden. The house standing today was built by Capt. John Huling Geiger between 1846 and 1849, after Audubon’s visit. The museum takes its name from the artist’s documented connection to the grounds.

What makes Audubon House important to Key West?

It was the first large-scale historic restoration on the island. Saved from demolition in 1958 by Mitchell and Frances Wolfson and opened as a museum in 1960, it sparked the preservation movement that produced the Historic Old Town district visitors come to see today.

How long does a visit to Audubon House and Tropical Gardens take?

Plan on 60 to 90 minutes. A guide introduces the property and its history, then you tour the house, the gallery, the replica cook house, and close to an acre of tropical gardens on your own schedule.

What are the hours at Audubon House?

The house is open daily from 9:30 a.m. to 4:15 p.m., with the gallery and gift shop open until 5 p.m. Hours can change seasonally, so check audubonhouse.org before your visit.

Where should I stay near Audubon House?

Old Town puts the museum within a short walk, along with the Custom House, Mallory Square, and the Historic Seaport. Potter’s Cottage sits on Whitehead Street itself, and Chavez House is a quick walk away on Margaret Street. Both are managed by Historic Key West Vacation Rentals — book direct and save.

Make the history part of the stay. Browse the largest selection of historic vacation homes across Old Town, Truman Annex, and the Historic Seaport at Historic Key West Vacation Rentals — locally owned and locally managed, and just steps from the houses that saved this island. Book direct and save, and call us today before your favorite home is gone.