Enhancing Privacy and Security Features for TalkTastic Users

First off, love what you’re creating. In a short time it has already genuinely changed and improved how I get info into my computer - oddly, particularly when doing long prompts 🤷‍♂️ For what its worth, my main feature request is actually just some assurances regarding privacy/security. And I feel this would resonate with a lot of folks who find out about it. When using TalkTastic regularly (as I now do) I feel nervous about having potentially private info sent away to someone else for processing. Two ways I could see addressing this:

More info about how its processed, end-to-end encryption or something like that.
BYO API key

➕2

❤️1

5 comments

Matt Mireles
·
·
We're doing a lot of research into on-device AI right now, which is the real solution here IMO. My main focus has been quality and reliability. From my perspective, we've got to make it work first. It needs to work consistently and be good. Once it actually works, then we'll tackle privacy and such. The biggest thing we're doing is pushing more compute to the device. This will make the product faster and lower our costs, so these goals are nicely aligned. Just so you know, once we roll out a pro mode, we'll be adding much more advanced privacy and data security protections as part of that.
Jamie
·
·
That would be amazing. Yes, agree that on-device is the best solution of all.
❤️1
Matt Mireles
·
·
We already have a hybrid local-cloud architecture where we do some of the compute locally, some in the cloud. But I think the next big latency gains and speed increases are going from the cloud to the computer. My theory is that we can effectively do transfer learning / distill capabilities of these bigger models to smaller models that run on your local device through model fine-tuning and personalization. And it'll be faster. There's a lot of stuff we're just trying to get working now, but this is cooking and you'll see some updates soon.
🙌1
Kirk (TorchPX)
·
·
I second the need here.
J.P. M
·
·
For those still on an Intel machine, going on device isn’t the best, will or can there be an option, to switch between ondevice and off, knowing that off means its slower?