The narrative opens in the Andalusian wilderness, where a French archaeologist meets a suspicious traveler later revealed to be the notorious bandit Jose Navarro. After sharing food and shelter, the narrator unwittingly aids the outlaw before parting ways, only to cross paths with him again in Cordova under darker circumstances involving a captivating gypsy woman named Carmen. Weeks later, imprisoned and awaiting execution, Don Jose recounts his tragic history to the narrator, explaining how his disciplined life as a Basque soldier unravelled the moment he encountered Carmen at the Seville tobacco factory. Her provocative defiance and bold allure draw Jose into a world of smuggling and violence, forcing him to abandon his military honor, murder rivals in jealous duels, and live as an outlaw in the mountains.
Despite his fierce devotion, Carmen refuses to be possessed or domesticated, openly defying his attempts to control her freedom and eventually turning her affections elsewhere. Driven to despair by her unyielding independence and rejection, Jose reaches his breaking point when she refuses to submit or flee with him, ultimately leading to the tragic climax in a lonely gorge where he takes her life. The novella concludes with an extensive ethnographic epilogue detailing the customs, language, and social isolation of the Spanish gypsies, offering insight into the fierce pride and fatalism that governed Carmen's existence.