(CNN) -

During the 138th annual "Greatest Two Minutes in Sports," bets will be lost, hearts will break and mint juleps will be sipped, but for many spectators at the Kentucky Derby and elsewhere, "It's all about the hats." And it's a time for the artists who craft these hats to sit back, rest their exhausted hands and look for their creations among the crowds on TV.

Peeking out of custom hatboxes, the one-of-a-kind Derby hats swoop, curl and entice, promising instant glamour.

But it's the moment when a woman carefully removes her crown from the clouds of hatbox tissue and places it at just the right angle, the brim dipping down alluringly over one eye and reaching up to the heavens at the other end, that she and her hat embody the same intriguing personality.

"It's theater ... a grand, glorious stage and anyone can participate," said Sally Faith Steinmann, owner and milliner for Maggie Mae Designs.

"My husband's mother went to the Derby when she was a teenager -- she's 98 years old -- and she remembers the sea of hats. In our culture, we don't have all that many occasions like this. There is nothing like it, from the infield to Millionaire's Row."

Any woman wearing the right hat can feel like queen for a day at the Derby event of her choice. Perhaps it is an escape from her daily life, or even daily persona, that lies behind the feminine mystery of Derby millinery.

From towering fascinators to 25-inch-wide Southern sloping brim hats, all adorned with an array of feathers, bows or giant flowers, each topper has a story to tell about the classically chic or flamboyantly bold woman wearing "her." The hat is too special to be an "it," Steinmann said.

While so many great traditions associated with the Derby, like the hats, largely stay the same, there is one constant unknown: the weather. If it rains, don't be surprised to witness a sea of bobbing plastic bags shielding these prize hats from the elements. After all, the custom creations will become heirlooms, passed down for generations.

It is why these hats, and their wearers, cause spectators at the Derby to take pause, snap photos and vote for them in contests. Some hats even wind up in the Kentucky Derby Museum at Churchill Downs. The colorful headpieces are also on display at the Kentucky Oaks, the "little sister of the Derby" race on Friday, as well as races like the Belmont Stakes and Preakness, or parties, high teas, luncheons and charity events planned around race season.

For the women who craft and sell these soft sculptures, hat-making is an intimate art form relying on the intricately plaited bond of creativity and tradition. For a true milliner, none of the hats is bought and spruced up -- these women are starting from scratch.

"I love making the bodies of the hat out of the silk dupioni, but then when it gets to trimming the hat, and I can actually take a strip of fabric and weave it, wind it and swirl it up with silk organza into a rose curl or a Marguerite, and I feel like a sculptor," Steinmann said.

In the same way a painter communicates with a custom palette, Steinmann and other designers speak fabric. They work with ruffles, layers, buttons, swirls, crinkles, rosettes and "feathers that dance in the sunlight" to create dazzling combinations of texture and hue that define the singular woman who requests one.

"It's the one time you can feel that you are in the lap of luxury," Detroit milliner Gena Conti explained. "It is an excuse. And sometimes we need an excuse to step outside ourselves and do something that we really want to do all along."

One of Conti's clients is celebrating her 30th birthday on Derby day. The woman had a choice: She could spend her money on great box seats for the Derby or buy outrageous hats. She bought mediocre seats and called Conti, asking for two hats.

Just how extreme is "outrageous"? Bespoke Derby hats and fascinators can cost anywhere from $135 to thousands, depending on the labor, materials and design.

Some milliners believe the average range to be between $300 and $500. But accents like ostrich feathers can be expensive on their own; not to mention Parisian silk hand-pleated ribbon, which can cost Conti $800 a spool.

Milliners are generally happy to work within a budget, but why are women willing to pay thousands for a hat that they may wear only a few times, or just once? Even if they can wear the hat to another race or luncheon, it won't be seen at another Kentucky Derby.

"People won't do it," said Diane Siverson, owner and milliner of Lady Diane Hats in Idaho. "I have a customer that buys one every year. They wouldn't dream of wearing it again -- it just isn't done."

But the hat is a memory, an heirloom and a work of art that is uniquely hers, Steinmann said. The Derby is a once-in-a-lifetime experience for some, because the expenses can add up quickly.

"People tell me 'I'll never get to do this again,' and I hear this time and time again, 'This is on my bucket list, and if I'm going to do it, I'm going to do it right,'" Siverson said.

While women preparing for the Derby or other events can look within their city for a milliner, many customers turn to searching online, which is how they find designers like Conti, Siverson, Steinmann and Jill Henning of Jill Henning Fineries, based in Toledo, Ohio.

"I never started this for money. I started because I love to create," Henning said. "The inspiration comes from everywhere."

For these women, millinery has become a second career, born out of a shared epiphany: "I want to make hats!"

They each took classes, apprenticed under other hat makers or worked off of a basic sewing knowledge and taught themselves millinery.

Conti and Siverson's inspiration stemmed from things they loved, like showcasing the flowers from their well-tended gardens. Henning was a fan of hats and used to buy them, but after finding only disappointment in department store selections, she began to make her own.