Tesla is creating San Francisco in a simulation to assist prepare Autopilot/FSD

September 21, 2022

By Kevin Armstrong

Tesla may be ramping up how it uses simulation to train its Autopilot system. A report by Electrek asserts that it has sources claiming that the company is concentrating on a reproduction of San Francisco. The article includes an image of the recreation and states that Tesla is working with Real Engine on its simulation.

According to Electrek, the image below is part of Tesla’s simulation of San Francisco.

An image of Tesla's San Francisco simulation that was obtained by Electrek

Tesla gave the world a look at how it uses simulation to advance the Autopilot program during the first AI Day in August of 2021 (recap).

AI Day

At the first AI Day Tesla talked about the use of using simulations to help train Autopilot. The video below is cued up to where they discuss a simulation.

Ashok Elluswamy, the Director of the Autopilot Program, showed a video that, at first glance, looked real other than an appearance by a Cybertruck. “I may say so myself. It looks very pretty,” said Elluswamy. He explained that the company is investing heavily in using simulation. “It helps when data is difficult to source. As large as our fleet is (FSD Beta users), it can still be hard to get some crazy scenes,” the director explained while showing a rendering of two people and a dog running in the middle of a busy highway. “This is a rare scene, but it can happen, and Autopilot still needs to handle it when it happens,” said Elluswamy.

It appears that Tesla has jumped on Fortnite’s Battle Bus by teaming up with Epic Games and its development platform — Unreal Engine. Fortnite is one of the most popular games of all time, with 80 million subscribers and 4 million daily users, and it was created with Unreal Engine. Epic flexed its creative muscles when it gathered experts to create The Matrix Awakens: An Unreal Engine 5 Experience. The goal was to “blur the boundaries between cinematic and game, inviting us to ask — what is real?” The project spotlight on Unreal Engine shows just how incredibly realistic a simulation can be.


After Elluswamy explained that the company is investing in simulation, it makes sense that Tesla would be hiring several positions with simulation in the job description. Electrek pointed out one posting for Autopilot Rendering Engineer. The posting states the successful candidate “will contribute to the development of Autopilot simulation by enabling and supporting the creation of photo-realistic 3D scenes that can accurately model the driving experience in a wide range of locales and conditions.” Tesla prefers the candidates have experience working with Unreal Engine.

While not new, this does show that Tesla is doubling down on efforts to improve Autopilot. It has recently rolled out Full Self Driving to 60,000 more users, bringing the FSD Beta program to 160,000 in North America.

We can only guess how many thousands of simulations the Autopilot team is conducting to add to the data the Beta testers are collecting. It seems unlikely that Tesla has only created the City by the Bay in its simulations. Perhaps Elluswamy will show more renderings at the second AI Day on September 30th.

September 30, 2022

By Nuno Cristovao

Tesla to show off its Tesla bot, Optimus tonight

Tesla is hosting its recruiting event, AI Day 2 tonight in Palo Alto, California.

Elon Musk said to expect a lot of technical detail and “cool” hardware demos. We don’t know which demos exactly, although Elon did say the event will be focused on AI and robotics.

Elon also talked about how these events are specifically aimed at showing off the exciting things Tesla is working on to attract more talent.

We can expect Tesla to show off its new Tesla bot, Optimus, talk about FSD and AI and possibly share some details on FSD hardware 4.0 and its upcoming Steam integration.

Pretty much. AI/robotics engineers who understand what problems need to be solved will like what they see.

— Elon Musk (@elonmusk) September 29, 2022

Start Time

The event took place in Palo Alto, CA on September 30th at 6:15 pm PT.

Watch on Demand

You can watch the event on demand below:

September 30, 2022

By Nakatomi2010

Tesla's Powerwall carried me through the post Hurricane Ian power outage

Back in 2017, I was in a home with solar panels, but no battery backup. Hurricane Irma passed overhead, and I found myself without power for 24-48 hours. We lost all of our food as a result.

When the storm passed, I called up the company that installed my solar panels and found that adding in a battery would be cost-prohibitive, as it would require replacing the solar inverter. As my wife and I started shopping for a new home for our family, I kept this information in mind as I had planned on having solar+battery put in at the new house. I worked on finding a home that would be oriented properly to get the best solar collection capacity, and we bought it in 2018.

Once the home was bought I went through the process of getting quotes for solar + battery arrays and ultimately settled on Tesla.

Tesla was largely chosen because, at the time, the Powerwall battery had the shortest cutover time in the event of an outage. It kicks in right away, while the others took 2-3 seconds to switch over.

By the end of 2018, the array and Powerwall were installed and operational. The array has a max output of 9.425 kW using a SolarEdge SE7600H-US inverter, which has a max output of 7.64 kW, and a single Gen 2 Powerwall 2. During the design, I chose not to have the HVAC and car chargers run off the Powerwall.

As Hurricane Ian approached, Tesla’s Storm Watch kicked in on the Powerwall.

The Powerwall started charging to 100% about two days before the hurricane made landfall. I debated on letting the Powerwall’s power get used leading up to landfall, but having been through hurricanes before, I opted to let Storm Watch do its thing. As the hurricane approaches it’s not uncommon for the winds to cause power stability issues. Leading up to the hurricane the power blinked numerous times.

By the afternoon of September, 28th people in the Tampa area were already starting to lose power.

At around 4:15-4:30 pm, as the winds outside were getting stronger, my wife and I decided to start making dinner for the kids. For reasons unknown, we decided to cook some things that involved the stove. At 4:42 pm the power blinked, and the Powerwall took over for about 5 minutes, putting us back on the grid at 4:47 pm. Once back on the grid the Powerwall charged back up to 100%.

At 5:03 pm on September 28th, the power went out again. After making dinner, we turned off the appliances and watched Andor on Disney+.When it was over I looked at the Powerwall’s status and found that we were now down to 91%.

Tesla's Powerwall showing the amount of energy left

There was a notice that said we had about 8.1 hours of power remaining, I started to cycle through the things in the house that consumed power and began shutting them off, either at the breaker box, or by unplugging them, intending to ensure there was enough power to keep our fridge, and a chest freezer in the garage online.

I was able to get us down to about .3-.4 kW of use before going to bed and hoped that was enough. Things that were turned off were the water heater, the dishwashers, computer gear, TVs, etc. Anything that might have vampire drain in the long run, including the internet gear.

At around 7 pm yesterday, two hours after the power had gone out, Tesla sent me an email with the VIN for my new Model Y.

I couldn’t help but chuckle at their timing.

I woke up the next morning, September 29th, at around 6:30 am. I had to connect to the Powerwall directly to check the stats since I had powered down the internet gear and Gen 2 Powerwalls don’t have cellular connectivity any longer due to AT&T’s 3G network being shut down earlier this year. I found that the Powerwall was down to 46%.

Tesla's Powerwall showing the amount of energy left

By this time the storm had moved beyond my area, and I went outside to start inspecting for potential property damage and such. Thankfully, we were spared property damage. The most we had was a panel that covers the service box for our internet cables get blown off the side of the house. I found it about 4 feet away and put it back on.

Others in the community I live in were less fortunate. Several smaller trees had been tipped over, some homes had shingles blown off their roof, and in at least one case a tree had fallen on top of a vehicle.

At 8 am I checked to see how many people in my neck of the woods were without power and found that the total increased from 21,2000 to 292,247 as the hurricane moved away.

The day after a hurricane is a tricky one, particularly if the hurricane is a big one because there’s still a lot of cloud cover. By around 8:38 am the Powerwall was at 36% charged and the sun was barely peaking out around the clouds, resulting in a lower power generation rate.

About 30 minutes later, at 9:10 am, enough sun was shining through the clouds for the Powerwall to start charging.

35% would be as low as the Powerwall went during this event.

As the day went on, we used power sparingly, mostly trying to ensure our mobile devices were charged. We used a microwave and a toaster oven to make breakfast, and at around 11 am I got a chuckle at my impact card showing 0% grid usage.

Tesla Solar's Impact card

By lunchtime, the Powerwall showed Storm Watch was over, and the Powerwall was charged to 68%.

So we again used the microwave and toaster oven to make lunch and feed the family.

At around 1 pm the Powerwall started to hit around 80-85% charged, and we started running into an issue with generating power. Every time the Powerwall generated more than 5kW of power, we got an error that read “DC VOLTAGE NOT SAFE! DO NOT DISCONNECT! VDC 445.4”

Followed by another “Error code 18×40 AC Freq too high”

Powerwall charging error

And then it would go to “Waking up…” and start a five-minute timer. Once the five-minute timer was done, the cycle would repeat, the array would generate 5 kW, give an error, and reboot.

I tried to open a support ticket with Tesla, first using the Tesla app. I started a chat session with someone who immediately disconnected the chat session saying “Weather-related issue”, as I was not on the grid.

Irritated, I re-opened the chat session and got a different person who worked with me.

Initially, the individual claimed that the issue was related to the overcast sky, however, that wasn’t the case as the inverter *does* shut down when there’s a lack of sunshine. In this case, it was shutting off every time it hit 5 kW generation. While still on chat support I used a different mobile device to call Tesla’s solar number. I received different answers from the chat advisor and the representative on the phone.

Chat support said that there did appear to be an issue and advised me to schedule a service ticket, and ended the chat.

The person on the phone took the time to explain to me what was happening, and ultimately resolved the issue. The Powerwalls are limited to 5 kW of intake. As I only had one Powerwall, once the array generated more than 5 kW of Power, the Powerwall was changing the frequency to tell the array “Whoa, stop, you’re giving me too much power”, which would reboot the array for five minutes, and repeat the cycle.

The solution to this issue is rather amusing.

You have to use more power to use the excess energy that the array is generating.

Armed with this new information I turned back on the dishwasher and the water heater, and started doing dishes, taking a shower, and watching TV. We eventually found a happy medium where we were using enough power to have the Powerwall stop shutting off the array and continue charging.

From 2 pm to 4 pm we greedily used power, but at 4 pm the intake wasn’t as good anymore as the sun was starting its trek to go below the horizon.

Tesla's app shows the amount of energy remaining

After the dishwasher finished, I turned the water heater and dishwasher back off and started going back to “low power” mode as we began making an early dinner, again, using the toaster ovens, and an air fryer.

We took some time to eat our food while watching TV, catching up on Paramount+’s Lower Decks, and Disney+’s She-Hulk, and we started turning things off again.

By 6:22 pm the Powerwall reached 98%. The sun finally went low enough on the horizon for power to stop being generated.

By the end of the day when we getting ready for bed, we still had no power.

By 2:15 am, on September 30th, I awoke to go pee, then sat on the edge of the bed and decided to check the Powerwall’s state of charge. I found it to be at 45% and heard a rumbling outside the bedroom door that turned into a roar.

After initially thinking it was an Amazon plane flying overhead, I got up and checked the thermostat to find that the HVAC had turned back on again. After checking the Tesla app again I found that power had been restored.

Tesla Solar's Impact card

Looking at the Impact card to try and see how long the outage was, I realized that Tesla’s app doesn’t seem to know how to handle an outage that’s longer than a day.

The power went out at 5:03 pm on Wednesday, September 28th, and ultimately returned at 2:17 am on Friday, September 30th. A total of about 32 hours being off-grid.

What would I do differently? Tough to say honestly.

Having to go to the garage to flip breakers to reduce or increase the power load was annoying, putting in a Smart breaker panel would’ve been beneficial, but only so long as we had internet access.

A second Powerwall would’ve been very beneficial as it would have allowed me to not have to increase the power load to ensure the Powerwall kept charging properly, as the power would’ve likely been split between them. If and when Tesla sells Powerwalls without requiring solar with it, this is an option I’ll be investigating for sure, as long as it isn’t cost-prohibitive. I’m uncertain if you can mix and match a Gen 3 Powerwall with a Gen 2 under a SolarEdge inverter.

Not having the HVAC, while unpleasant, wasn’t a huge deal. After a hurricane clears out of an area, you’re generally left with a lot of cold air, so we just opened the windows for a bit. Having EV chargers was also a non-issue because we didn’t drive anywhere, and the cars only lost about 2-3% charge, mostly from me opening the Tesla app and accidentally waking up the cars while trying to scroll to the Solar card.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button